Azure Data Engineer

Azure Data Engineer – Offshore, India

Experience: 8–10+ years

Engagement: 3 months

Location: Offshore, India

Role Summary

We are looking for an experienced Azure Data Engineer to design, develop, and optimize data integration and ETL/ELT pipelines using Microsoft Azure technologies. The resource will work with the CIT Data Team to build scalable data solutions and integration feeds across various applications.

Key Responsibilities

• Design and develop data pipelines using Azure Data Factory (ADF).
• Build and optimize integrations across ADLS, Azure Synapse, Databricks, Azure SQL, SAP, XML, flat files, and databases.
• Develop ETL/ELT solutions using SQL, Python/PySpark, Spark, and Azure services.
• Perform data modeling, data warehousing, data governance, metadata, and data quality activities.
• Optimize pipeline performance and ensure adherence to IFC technical standards.
• Develop unit/integration test cases and support application feed testing.
• Prepare technical/functional design documents and other project artifacts.
• Work in an Agile/SDLC environment and collaborate with project leads and business/data teams.
  
  

Mandatory Skills

• Strong hands-on experience with Azure Data Factory, Azure Databricks, ADLS, Azure Synapse, Azure SQL.
• Strong SQL Server/Oracle and complex SQL query skills.
• Experience with Python/PySpark and Spark.
• Strong ETL/ELT and data warehouse/data lake experience.
• Experience with Informatica and/or SSIS is an advantage.
• Knowledge of Azure Functions, Logic Apps, Automation, PowerShell, AzCopy, Azure DevOps/ARM templates.
• Strong understanding of data architecture, modeling, ingestion, curation, and raw/enriched/curated data layers.
• Experience delivering end-to-end data warehousing, BI, and analytics projects.
• Bachelor's degree in Computer Science, Engineering, MIS, or related field.
  
  

Preferred: Experience with real-time/near-real-time data warehousing and enterprise data integration.

Skills: data,sql,azure,data warehousing,etl