Senior Consultant-Tech Consulting-National-CNS-TC-AI and Data
Ernst Young · Noida · onsite · Posted today
Undisclosed5–9 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Summary
Senior Consultant-National-Tech Consulting-CNS - TC - AI and Data - Noida
Responsibilities- Design, develop, and maintain scalable Python-based microservices for data ingestion and processing.
- Build and optimize microservices to support end-to-end ETL pipelines for large-scale batch and streaming data.
- Develop and manage distributed data processing workflows using Apache Spark and PySpark.
- Create, schedule, and monitor workflows using Apache Airflow.
- Design and deploy data pipelines on AWS EMR or similar big data platforms using Python.
- Implement real-time data ingestion and streaming pipelines.
- Ensure data quality, reliability, performance, and scalability of data systems.
- Apply best practices for code quality, testing, CI/CD, and production monitoring.
- Troubleshoot production issues and perform root-cause analysis.
- 68 years of experience in Data Engineering or backend data platform roles.
- Strong proficiency in Python with experience building production-grade microservices.
- Hands-on expertise with Apache Spark and PySpark.
- Experience working with AWS EMR or equivalent cloud-based big data services. (Must have knowledge on AWS ecosystem)
- Strong experience with Apache Airflow for workflow orchestration.
- Deep understanding of ETL pipeline design and data modeling.
- Hands-on experience with Kafka for inter-domain communication and real-time or streaming data pipelines.
- Strong experience with PostgreSQL or similar RDBMS.
- Experience working in Agile/Scrum environments.
- Bachelor of Technology in Computer Science
- Master of Computer Applications
- Data Engineering (4+ years)
- Python
- Apache Spark
- PySpark
- Apache Airflow
- AWS EMR
- Kafka
- PostgreSQL
- data modeling
- Agile/Scrum
Sourced from naukri
Skills
data qualityBusiness ConsultingAgileApache SparkData ingestioncode qualityApachedata systemsamazon web servicesapache airflowAws EmrData EngineeringcloudData ProcessingETLData ModelingData PipelineBig DataArtificial Intelligence
About Ernst & Young

Ernst Young
Management Consulting
44k+
employees
2002
24 years old
Gurgaon / Gurugram, Haryana
India
₹15.3L PA avg
Avg at Ernst & Young
About
At EY, our purpose is Building a better working world. The insights and quality services we provide help build trust and confidence in the capital markets and in economies the world over.
Industries
Management Consulting
Employee ratings
10 reviews
3.4/ 5
Culture
1.9
Career growth
2.3
Work-life
2.5
Employees rate it well for
Job Security36Skill Development35
Find them on