HYDERABAD · FULLTIME
Data Engineer
Talentmatics
Hyderabad · onsite · Posted 12d ago
Sourced from
Undisclosed7–10 yrsfulltimeHyderabad
Your match
?
Sign in to see your match score, skill gaps & tailored resume.
Section · 01
About this role
We are seeking skilled
Data Engineers with strong hands-on experience in
AWS, Python, Spark, and modern Data Engineering practices to join our growing team.
Location: Hyderabad
Experience: 7–10 Years
Notice period :Immediate to 30 Days
Key Responsibilities :
- Build and enhance ETL/ELT pipelines to ingest, transform, and curate data from multiple sources into trusted datasets.
- Develop and maintain data processing jobs using Python and Apache Spark, ensuring performance, scalability, and reliability.
- Implement and monitor data quality checks, perform reconciliations, and resolve data-related issues.
- Support production data pipelines, including monitoring, incident management, root cause analysis, and SLA adherence.
- Design and manage workflows using Apache Airflow (MWAA) and AWS-native services.
- Translate business requirements into technical solutions and maintain documentation, runbooks, and operational playbooks.
- Collaborate with onsite stakeholders and distributed engineering teams to deliver high-quality data solutions.
Mandatory Skills :
- 7+ years of Data Engineering experience.
- Strong expertise in Python and SQL.
- Hands-on experience with Apache Spark / PySpark.
- Experience building and supporting ETL/ELT pipelines.
- Strong AWS experience with S3, Glue, Lambda, IAM, CloudWatch, and Airflow (MWAA).
- Experience with CI/CD practices.
- Infrastructure as Code experience (Terraform preferred).
- Strong troubleshooting and production support experience.
Sourced from linkedin · view original
Let the agent run this one for you.
Tailored resume, auto-apply, and referral lookup — in under 2 minutes.
Section · 02
Skills
PysparkPythonSQLETLCi/CdTerraformAws GlueAws LambdaApache Sparkaws iamamazon web servicesinfrastructure as codeapache airfloweltAWS CloudWatchAWS S3MWAA