Aws Data Engineer

JD For AWS data Engineer

Exp 2 to 5 years

Location: Mumbai Goregaon

AWS Data Engineer / Sr Data Engineer

Core Responsibilities

• Design and Build Data Infrastructure:

Create and maintain robust data architecture, including data pipelines, data warehouses, and data lakes.

• Develop Data Pipelines:

Implement ETL (Extract, Transform, Load) processes and workflows to extract, transform, and load data from various sources into AWS data stores.

• Utilize AWS Services:

Work with key AWS services such as S3 (for storage), Glue (for ETL), EMR (for processing), Redshift (for data warehousing), and Lambda (for serverless functions).

• Ensure Data Quality and Security:

Implement data governance policies, data security measures, and data integrity checks to maintain data reliability and security.

• Collaborate with Stakeholders:

Partner with data scientists, business analysts, and other teams to understand data needs and build solutions that align with business goals.

• Monitor and Optimize:

Use tools like CloudWatch to monitor system performance and optimize AWS resource usage for cost-efficiency.

Key Skills and Qualifications

• Technical Skills:
1. AWS: Deep understanding of AWS services, especially S3, Glue, EMR, Redshift, and Lambda.
2. Programming Languages: Proficiency in Python and SQL for data manipulation and scripting.
3. Data Technologies: Experience with data modeling, data warehousing, ETL tools, and big data technologies like Spark.
4. Data Governance: Knowledge of data governance, compliance, and data privacy best practices.
• Soft Skills:
1. Problem-Solving: Ability to troubleshoot and resolve data-related issues.
2. Collaboration: Strong teamwork skills to work effectively with cross-functional teams.
3. Communication: Ability to clearly document solutions and effectively communicate technical details to different audiences.

Educational Background

• A bachelor's degree in Computer Science, Information Technology, or a related field is often a requirement.