PUNE · FULLTIME
Data Engineer-Data Platforms-AWS
IBM
Pune · onsite · Posted 5d ago
Sourced from
Undisclosed5–10 yrsfulltimePune
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
Your Role and Responsibilities:
As a Data Engineer specializing in Data Platforms on AWS, you will advise on, develop, and maintain data engineering solutions on the AWS Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various AWS services.
Your Primary Responsibilities Will Include:
- Design and Develop Data Pipelines: Design, build, and operate batch and real-time data pipelines using AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis, ensuring seamless integration and operation of data engineering solutions.
- Create Data Layers: Create data layers on AWS RedShift, Aurora, and DynamoDB, and migrate data using AWS DMS.
- Manage Data Services: Schedule and manage data services on the AWS Platform, ensuring efficient operation of data engineering solutions.
- Develop Batch and Real-time Pipelines: Develop batch and real-time data pipelines for Data Warehouse and Datalake, utilizing AWS Kinesis and Managed Streaming for Apache Kafka.
- Utilize Open Source Technologies: Utilize open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on AWS Platform to support data engineering solutions.
Required Education:
Bachelor's Degree
Preferred Education:
Master's Degree
Required Technical and Professional Expertise:
- Exposure to AWS Toolset: Experience working with AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis to design, build, and operate batch and real-time data pipelines.
- Data Pipeline Development: Exposure to developing batch and real-time data pipelines for Data Warehouse and Datalake, utilizing AWS Kinesis and Managed Streaming for Apache Kafka.
- Data Layer Creation: Experience working with AWS RedShift, Aurora, and DynamoDB to create data layers and migrate data using AWS DMS.
- Open Source Technologies: Exposure to utilizing open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on AWS Platform to support data engineering solutions.
- Data Service Management: Experience scheduling and managing data services on the AWS Platform, ensuring efficient operation of data engineering solutions.
Preferred Technical and Professional Experience:
- Proficiency with AWS Databrew: Experience working with AWS Glue Databrew to support data engineering solutions, including data preparation and data quality tasks.
- Knowledge of Lambda Functions: Exposure to using Lambda functions with Python to support data engineering solutions, including data processing and data transformation tasks.
- Familiarity with RedShift Spectrum: Experience working with RedShift Spectrum to support data engineering solutions, including data warehousing and data analytics tasks.
Years of Experience:5 - 10
Sourced from naukri
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
Aws GlueData EngineerApache KafkaAuroraaws kinesisApachedata preparationAws Servicesdata platformsamazon web servicesredshiftapache airflowAws EmrAnalyticsData AnalyticsData EngineeringcloudData Pipeline
Section · Company
About IBM
IBM
IT Services & Consulting
130k+
employees
1911
115 years old
Bangalore / Bengaluru, Karnataka
India
About
IBM has been dedicated to every client's success and to creating innovations that matter for the world.
Industries
IT Services & ConsultingFinancial ServicesEmerging Technologies
Employee ratings
25,767 reviews
3.9/ 5
Culture
3.9
Career growth
3.0
Work-life
4.0
Employees rate it well for
Work Life Balance4166Salary3460Work Culture2867Learning2246Senior Management1890
Find them on