Lead Data Migration Engineer (ETL & Azure Databricks) | Experience: 8–12+ Years | Location: Noida / Pune / Bangalore / Jaipur (Hybrid)

Position: Lead Data Migration Engineer (ETL & Azure Databricks)

Experience: 8–12+ Years Location: Noida / Pune / Bangalore / Jaipur (Hybrid)

Job Summary We are looking for an experienced Lead Data Migration Engineer to lead enterprise-scale data migration initiatives. The ideal candidate will have extensive expertise in designing and implementing ETL solutions, Azure Databricks, SQL, and data quality management. The role involves leading end-to-end migration activities, ensuring data integrity, optimizing migration performance, and collaborating with cross-functional teams to deliver successful migration projects.

Key Responsibilities Lead end-to-end data migration projects from planning through production deployment. Design, develop, and optimize scalable ETL pipelines for extracting, transforming, and loading large datasets. Build and enhance data migration solutions using Azure Databricks. Perform data profiling, cleansing, transformation, reconciliation, and validation to ensure data accuracy. Define and implement data survivorship, deduplication, and data quality rules. Analyze and resolve complex data migration issues while ensuring minimal business disruption. Collaborate with business stakeholders to validate migrated data and ensure business requirements are met. Work closely with QA teams during functional, integration, and UAT testing phases. Prepare migration strategies, source-to-target mapping documents, technical specifications, and deployment documentation. Ensure adherence to enterprise data governance, compliance, and security standards. Mentor junior team members and provide technical leadership throughout the migration lifecycle. Participate in Agile ceremonies including sprint planning, reviews, and retrospectives.

Required Skills 8+ years of hands-on experience in Data Migration and ETL Development. Strong experience with Azure Databricks. Expertise in designing and developing ETL pipelines. Advanced SQL programming and query optimization skills. Strong understanding of data profiling, data cleansing, reconciliation, validation, and migration best practices. Experience implementing survivorship and deduplication logic. Strong analytical, troubleshooting, and problem-solving skills. Experience handling large-scale enterprise data migration projects. Excellent stakeholder management and communication skills. Ability to lead technical teams and coordinate with cross-functional stakeholders.

Preferred Skills Experience with Master Data Management (MDM). Hands-on experience with Azure Data Factory (ADF). Knowledge of Azure Synapse Analytics. Experience working with Apache Spark. Familiarity with Agile/Scrum delivery methodologies. Experience with cloud-based enterprise data platforms.

Mandatory Skills Data Migration Azure Databricks ETL Development SQL Data Profiling Data Cleansing Data Validation Data Reconciliation Data Quality Management Deduplication & Survivorship Azure Cloud Secondary Skills Azure Data Factory (ADF) Azure Synapse Analytics Apache Spark Master Data Management (MDM) Agile/Scrum Soft Skills Excellent communication and presentation skills. Strong leadership and stakeholder management. Ability to work independently and drive migration initiatives. Strong documentation and analytical abilities.