Azure Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Storage solutions such as Blobs, Files, and Databases.
• Collaborate with cross-functional teams to understand business requirements and design scalable data architectures that meet those needs.
• Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Databricks.
• Ensure high availability of critical systems by implementing monitoring tools like Prometheus/Grafana/New Relic.

Job Requirements :

• 5-8 years of experience in a similar role as an Azure Data Engineer or related field.
• Strong expertise in working with Azure DataBricks, PySpark, Python programming language.
• Experience with SQL querying languages including T-SQL.