Senior Azure Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, load data from various sources into Azure Storage solutions.
• Collaborate with cross-functional teams to gather requirements for ETL processes and ensure seamless integration with existing systems.
• Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Databricks.
• Ensure high availability of ETL jobs by implementing monitoring tools such as Logic Apps.

Job Requirements :

• 7-11 years of experience in designing and developing large-scale data pipelines using ADF or similar technologies.
• Strong understanding of Python programming language for scripting tasks within an ETL process.
• Experience working with Azure Databricks for big data processing tasks.