Aws Data Engineer

Hiring for One of the topmost MNC!!

ROLE: AWS Data Engineer

Exp: 5 to 8 YRS

Location: Chennai, Bengaluru, Hyderabad

Work mode: 5 Days work from office

Notice Period: 0-30 Days Only

Role Overview

We are looking for an experienced AWS Data Engineer to design, develop, and maintain scalable data pipelines and data warehouse solutions on AWS. The ideal candidate should have strong hands-on experience with AWS Glue, Amazon Redshift, SQL, and Python, along with a good understanding of ETL/ELT processes and data engineering best practices.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using AWS services.
• Develop and maintain AWS Glue Jobs, Crawlers, Workflows, and Data Catalog.
• Build and optimize data pipelines for loading data into Amazon Redshift.
• Develop complex SQL queries, stored procedures, views, and transformations.
• Perform data extraction from various sources such as databases, APIs, files, and cloud storage.
• Work extensively with Amazon S3 for data storage and staging.
• Implement data transformations using Python/PySpark and AWS Glue.
• Optimize Redshift performance through appropriate distribution keys, sort keys, table design, and query optimization.
• Implement incremental data loading and CDC (Change Data Capture) processes where required.
• Monitor and troubleshoot data pipelines, ETL failures, and data-quality issues.
• Implement data validation and reconciliation processes to ensure data accuracy.
• Schedule and orchestrate data workflows using AWS services or other orchestration tools.
• Implement security and access controls using AWS IAM.
• Work with DevOps teams to implement CI/CD for data pipelines.

--
Thanks & Regards
Nikhil C
IT Staffing Analyst
Black and White Business Solutions Pvt.Ltd.
Bangalore,Karnataka,India.
[email removed]|www.blackwhite.in