Aws Data Engineer

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale data pipelines using AWS services such as S3, Glue, Lambda, Step Functions.
  
• Collaborate with cross-functional teams to gather requirements and design solutions that meet business needs.
  
• Develop complex SQL queries to extract insights from large datasets stored in Postgres databases.
  
• Troubleshoot issues related to data processing workflows and resolve them efficiently.
  

Desired Candidate Profile

• 6-8 years of experience in building data engineering solutions on AWS platform.
  
• Strong understanding of Python programming language and its application in big data processing.
  
• Experience with ETL processes using AWS Glue or similar tools (e.g., Airflow).
  
• Proficiency in working with PostgreSQL databases and ability to write complex SQL queries.
  
• Familiarity with serverless computing concepts through experience with AWS Lambda functions.