Aws Data Engineer

We are seeking a skilled AWS Cloud Data Engineer with strong expertise in AWS Glue, PySpark, EMR, Python, ETL Pipelines, and AWS Cloud Services. The ideal candidate will be responsible for building, maintaining, and optimizing scalable data pipelines while ensuring high data quality, reliability, and performance across enterprise data platforms.

The role requires hands-on experience in AWS Data Engineering, cloud-native architectures, CI/CD support, and stakeholder collaboration within Agile environments.

Key Responsibilities

Data Engineering & ETL Development

• Design, develop, and maintain scalable ETL/ELT pipelines using AWS Glue and PySpark.
• Build and optimize enterprise data ingestion and transformation frameworks.
• Develop and support batch and large-scale data processing solutions on AWS.
• Ensure reliability, scalability, and performance of data pipelines.

AWS Cloud Development

• Work with AWS services including:
  
• AWS Glue
• Amazon EMR
• Amazon S3
• AWS Lambda
• AWS IAM
• AWS CloudFormation
• Elastic Load Balancer (ELB)
• Support cloud-based data engineering and analytics solutions.
  
• Implement automation and deployment processes for AWS environments.
  

Data Quality & Governance

• Monitor and improve data quality, consistency, and reliability.
• Identify data quality issues and recommend corrective actions.
• Implement best practices for data validation and governance.
• Optimize workflows and improve operational efficiency.

DevOps & Monitoring

• Support CI/CD build and deployment activities.
• Assist in AWS monitoring setup and operational support.
• Build dashboards and monitoring solutions for AWS services and traffic trends.
• Coordinate incident tracking and resolution processes.

Agile Delivery & Collaboration

• Collaborate with business and technical stakeholders to gather requirements.
• Participate in Agile/Scrum ceremonies and sprint planning activities.
• Support technical mentoring and knowledge sharing within the team.
• Contribute to technical documentation and engineering standards.

Required Skills

• Strong hands-on experience with:
  
• AWS Glue
• PySpark
• Experience with:
  
• Amazon EMR
• Amazon S3
• AWS IAM
• AWS Lambda
• CloudFormation
• Strong Python programming skills.
  
• Experience building ETL and Data Engineering solutions.
  
• Knowledge of AWS monitoring and support processes.
  
• Experience in CI/CD build and deployment support.
  
• Strong understanding of cloud-based data platforms and architectures.
  
• Excellent communication and stakeholder management skills.
  

Preferred Skills

• Scala.
• AMI Rehydration.
• AWS Traffic Monitoring.
• Data Quality Frameworks.
• Enterprise Data Governance.
• Agile and Scrum methodologies.
• BFSI domain experience.

Desired Candidate Profile

• Strong analytical and problem-solving abilities.
• Ability to work effectively in distributed teams.
• Strong ownership mindset.
• Excellent documentation and communication skills.
• Ability to thrive in fast-paced Agile delivery environments.