Azure Data Engineer

***We are looking for Azure Data Engineer who can join us immediately at our Bangalore Office ***

Job Description:

We are seeking a highly skilled ETL Data Migration Engineer with experience in designing, developing, and implementing large-scale data migration and data integration solutions on the Azure platform. The ideal candidate will have strong hands-on expertise in Azure Data Factory (ADF), Azure Databricks, SQL, PySpark, Python, and Azure DevOps. The candidate will be responsible for migrating data from legacy systems to modern Azure-based data platforms while ensuring data quality, performance, and reliability.

Key Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
• Build and optimize data transformation processes using Azure Databricks and PySpark.
• Perform end-to-end data migration activities from legacy systems to Azure-based data lakes and data warehouses.
• Analyze source-to-target mappings and implement complex business transformation logic.
• Develop reusable data ingestion frameworks and automation solutions. Write efficient and optimized SQL queries, stored procedures, and performance tuning solutions.
• Implement data validation, reconciliation, and data quality checks during migration activities.
• Collaborate with Business Analysts, Architects, QA teams, and stakeholders to understand data requirements.
• Support deployment, release management, and CI/CD processes using Azure DevOps. Troubleshoot production issues and provide timely resolutions.
• Participate in code reviews and ensure adherence to development best practices.
• Create and maintain technical documentation, migration runbooks, and deployment guides. Support Agile ceremonies including Sprint Planning,
• Daily Scrum, Retrospectives, and Release activities.

Required Technical Skills

Must Have

• Azure Data Factory (ADF)
• Azure Databricks
• PySpark
• SQL Server / DB2 / Relational Databases
• Python
• Azure DevOps
• ETL/ELT Development
• Data Migration & Data Integration
• Source-to-Target Mapping
• Data Validation and Reconciliation
• CI/CD Pipelines
• Medallion Architecture (Bronze, Silver, Gold)

Key Competencies

• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management skills.
• Ability to work in Agile/Scrum environments. Ownership mindset and proactive approach to delivery.
• Ability to mentor junior team members and drive technical excellence.