Azure Data Engineer

Key Responsibilities

• Design and develop data pipelines using Azure Data Factory (ADF).
• Build and maintain data solutions on Azure Cloud.
• Develop ETL/ELT processes for data ingestion and transformation.
• Work with Azure Databricks for large-scale data processing.
• Implement and optimize data models and data warehouses.
• Integrate data from multiple sources into Azure Data Lake.
• Monitor, troubleshoot, and optimize data workflows.
• Collaborate with business and analytics teams to support reporting and data needs.

Required Skills

• Strong experience with Azure Data Factory (ADF).
• Hands-on experience in Azure Databricks.
• Experience with Azure Data Lake Storage (ADLS).
• Strong SQL and database concepts.
• Experience in PySpark and Python.
• Knowledge of ETL/ELT development.
• Experience with Azure Synapse Analytics.
• Understanding of data warehousing concepts.

Preferred Skills

• Azure DevOps and CI/CD pipelines.
• Experience with Spark and Big Data technologies.
• Power BI integration experience.
• Knowledge of Delta Lake.
• Exposure to Kafka/Event Hub.

Educational Qualification

• Bachelor's or Master's degree in Computer Science, IT, or a related field.