Lead Azure Data Engineer

This role is for one of our clients Industry: IT Services and IT Consulting Seniority level: Mid-Senior level Experience: 4+ yrs Location: Bengaluru, Pune, Hyderabad, NCR, Chennai Job Type: full-time We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us. We are seeking a Data Engineer / Senior Data Engineer to design, build, and optimize large-scale cloud-based data platforms that support business intelligence, analytics, and data-driven decision-making. This role focuses on developing modern data pipelines, data lakes, and warehouse solutions while working with real-time and batch processing systems in a cloud environment. You will collaborate with cross-functional teams to deliver scalable, high-quality data architectures that enable actionable insights across the organization.

Requirements Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines for processing large volumes of structured and unstructured data
• Build and manage cloud-based data platforms, including data lakes, data warehouses, and analytics solutions
• Develop and optimize data pipelines using Spark, PySpark, and cloud-native data services
• Work with real-time and batch data processing frameworks to ensure reliable and efficient data delivery
• Design robust data models and implement best practices for data quality, governance, and performance
• Optimize SQL queries, database performance, and large-scale analytics workloads
• Develop and maintain reporting and visualization solutions to support business stakeholders
• Collaborate with business, engineering, analytics, and product teams to define data requirements and solutions
• Support CI/CD processes, automation, monitoring, and deployment of data engineering solutions
• Create technical documentation and ensure adherence to modern engineering and data management standards

What Makes You a Great Fit

• 7+ years of experience in Data Engineering, ETL development, and cloud-based analytics solutions
• Strong expertise in Azure Data Factory, Databricks, Azure Synapse Analytics, Spark, and PySpark
• Hands-on experience with data lakes, Delta Lake architecture, and modern big data technologies
• Strong SQL development, query optimization, and performance tuning skills
• Experience designing scalable cloud-hosted data platforms and enterprise-grade data architectures
• Knowledge of reporting and analytics tools, including data modeling and dashboard development
• Familiarity with CI/CD pipelines, DevOps practices, and cloud security concepts such as RBAC
• Strong problem-solving, communication, and stakeholder management skills
• Ability to translate business requirements into scalable technical data solutions while maintaining high standards of quality and reliability