AWS Lead Data Engineer

Responsibilities :

Develop and maintain scalable data pipelines using AWS Glue, Lambda, and Step Functions. Build and optimize data ingestion frameworks on Amazon S3-based data lakes. Design and implement complex ETL/ELT workflows for structured and unstructured data. Develop reusable components and automation frameworks for data processing. Implement data governance and access control using Lake Formation and IAM. Deploy and manage containerized workloads on ECS. Optimize data processing performance, reliability, and scalability. Perform troubleshooting, root cause analysis, and production support activities. Collaborate with cross-functional teams to deliver business-driven data solutions. Mentor junior engineers and provide technical guidance to project teams.

Technical and Professional Requirements:

IT experience with strong Data Engineering background. Hands-on expertise in AWS Glue, Lambda, Step Functions, S3, and Lake Formation. Strong programming experience in Python and SQL. Experience building enterprise-scale Data Lake solutions. Good understanding of IAM roles, policies, and AWS security best practices. Experience with container technologies and ECS. Strong knowledge of ETL, Data Warehousing, and Data Modeling concepts. Experience working in Agile delivery environments.