Lead Azure Data Engineer

Lead Azure Data Engineer

Role: Lead Azure Data Engineer

Experience: 15-20 Years

Location: Bangalore / Chennai / Hyderabad / Mumbai / Pune

Notice Period: 0-30 Days

Employment Type: Full-Time

About the Role

We are seeking a highly experienced Lead Azure Data Engineer to drive the design, development, and modernization of enterprise-scale data platforms on Microsoft Azure. The ideal candidate will possess deep expertise in Azure-native data technologies, modern data architectures, and large-scale cloud transformation initiatives.

This role requires a strong technical leader who can architect scalable data solutions, mentor engineering teams, collaborate with stakeholders, and deliver business-critical data platforms that support analytics, reporting, and data-driven decision-making. [EP-JD_Azur...gineer ING | Word]

Key Responsibilities

• Lead the end-to-end design and implementation of modern Azure Data Platforms.
• Architect and develop scalable ETL/ELT pipelines using Azure Data Factory (ADF).
• Build and optimize data processing frameworks using Azure Databricks, PySpark, and Spark SQL.
• Design and implement Lakehouse / Medallion Architecture leveraging ADLS Gen2 and Delta Lake.
• Develop enterprise-grade data models and analytics solutions using Azure Synapse Analytics and Azure SQL.
• Drive data ingestion, transformation, orchestration, and performance optimization initiatives.
• Establish best practices around data governance, security, compliance, and operational excellence.
• Collaborate with business stakeholders, architects, product owners, and analytics teams to deliver high-value solutions.
• Mentor and guide Data Engineers while providing technical leadership across multiple projects.
• Implement DevOps, CI/CD, automation, and monitoring frameworks for data engineering solutions.

Mandatory Skills

• Azure Data Factory (ADF)
• Azure Databricks
• Azure Synapse Analytics
• Azure Data Lake Storage Gen2 (ADLS Gen2)
• PySpark
• Spark SQL
• Azure SQL Database / Azure SQL Data Warehouse
• Delta Lake
• Data Warehousing Concepts
• ETL / ELT Design & Development
• Azure DevOps / CI-CD
• SQL / T-SQL

Preferred Skills

• Snowflake
• Power BI
• Azure Key Vault
• Azure Event Hub
• Azure Stream Analytics
• RBAC & Data Governance
• Lakehouse Architecture
• Data Quality Frameworks
• Metadata-Driven Data Pipelines

Leadership Expectations

• Lead and mentor teams of Data Engineers.
• Drive solution architecture discussions and technical decision-making.
• Engage with business and technology stakeholders.
• Support delivery planning, estimation, risk management, and technical governance.
• Ensure adherence to enterprise architecture and engineering standards.

Candidate Profile

• 15+ years of overall IT experience.
• 7+ years of hands-on Azure Data Engineering experience.
• Proven experience delivering enterprise-scale cloud data transformations.
• Strong understanding of modern data architectures and engineering best practices.
• Excellent communication, stakeholder management, and leadership skills.
• Azure certifications such as DP-203 (Azure Data Engineer Associate) are highly preferred.