Data Engineer

JOB Description : Role: Senior Data Engineer Location: Chennai / Bengaluru Work Mode : Hybrid Notice Period: Immediate to 15 days Years of Exp: 4+ Years

About the Role:

• We are looking for a highly skilled Senior Data Engineer with ML to design, build, and operate reliable, scalable, and cost-efficient data pipelines.
• This role focuses on production grade data systems using Python and modern
• orchestration tools, with strong collaboration across Data Science and analytics teams.
• You will play a key role in enabling high-quality, well-governed, and discoverable data across the organiza tion. Key Responsi bilities 🔹 Data Pipeline Engineering
• Design, build, and maintain robust, scalable data pipelines using Python
• Develop and manage orchestration workflows using Apache Airflow / Google Cloud Composer.
• Ensure high availability, fault tolerance, and performance of data work flows.
• Implement monitoring, alerting, and observability best practices. 🔹 Production Operations &; Reliability
• Own scheduling, monitoring, and incident management for data pipelines.
• Ensure SLAs and data freshness requirements are met.
• Implement proactive quality checks and validation frameworks
• Optimize pipelines for performance and cost-efficiency in cloud environments 🔹 Data Governance & Collaboration
• Define and enforce data contracts across producers and consume
• Contribute to and maintain a data catalog.
• Partner closely with Data Science and Analytics teams for schema alignment, data
• discovery, and pipeline optimization.
• Support reproducibility and transparency of datasets used in modelling 🔹 Cloud & Architecture
• Work within Google Cloud Platform (GCP) environments
• Design cost aware architectures and storage strategies
• Improve CI/CD, version control, and deployment workflo ws for data systems. Required Skills &
• Strong proficiency in Python with ML Deployment(must)
• Hands-on experience with Apache Airflow and/or Google Cloud Composer
• Experience building and maintaining production data pipelines.
• Strong understanding of Workflow orchestration (Airflow)
• Monitoring & alerting Data quality frameworks.
• Scheduling & dependency management.
• Experience with cloud platforms (preferably GCP)
• Solid understanding of data modeling and pipeline design principle
• Experience implementing or working with data contract Exposure to data
• catalogs and meta data management.
• Strong operational mindset with focus on reliability and maintain ability