Senior Data Engineer (Senior Associate Data Engineering)
Innova ESI Private Limited · Delhi · onsite · Posted 3d ago
About a minute. You'll make an account on the way through.
About this role
Role :Senior Data Engineer (Senior Associate – Data Engineering)
Experience : 9+ Years
Location : Delhi NCR
Immediate Joiners Only.
We are looking for an experienced Senior Data Engineer with strong hands-on expertise in PySpark and Apache Spark who can independently support job validation, optimize data pipelines, and guide client teams on effective data validation techniques.
Key Responsibilities
- Design, develop, and support large-scale batch and real-time data pipelines.
- Build and optimize ETL/ELT pipelines using PySpark, Apache Spark, and AWS services.
- Perform job validation, troubleshoot issues, and ensure data quality and accuracy.
- Guide client teams on data validation strategies and best practices.
- Develop and optimize data transformation workflows and data models.
- Integrate third-party vendor data through APIs.
- Collaborate with cross-functional teams to deliver scalable data engineering solutions.
- Contribute to infrastructure optimization, automation, and CI/CD initiatives.
Required Skills
Strong hands-on experience with PySpark and Apache Spark 7+ years of experience building ETL pipelines for large datasets 3+ years of experience with AWS services such as S3, Glue, Aurora, and Databricks Strong SQL and Python programming skills Experience in data modeling, database design, and legacy data migration Good understanding of data quality, job validation, and pipeline optimization
Good to Have
- API development and Redis or other in-memory database experience
- AWS Lambda, IAM, Step Functions, and CloudWatch
- Infrastructure as Code (IaC), automation tools, and CI/CD pipelines
- Relevant AWS certifications
Sourced from foundit