Aws Data Engineer

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale data pipelines using AWS services such as S3, Glue, Lambda, Step Functions.
  
• Develop ETL processes using Scala/Spark/Hive/Oozie to extract insights from structured and unstructured data sources.
  
• Ensure high availability and scalability of the system by implementing monitoring tools like CloudWatch and X-Ray.
  

Desired Candidate Profile

• 6-8 years of experience in building large-scale data systems on cloud platforms (AWS).
  
• Strong proficiency in programming languages such as Python or Scala with hands-on experience working with Spark/Hive/Oozie.
  
• Experience developing complex workflows using Hadoop ecosystem components like Oozie scheduler.