Azure Data Engineer

Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions.
  
• Collaborate with cross-functional teams to identify business requirements and design scalable data architectures that meet those needs.
  
• Develop complex SQL queries to optimize database performance and troubleshoot issues in relational databases such as SQL Server or PostgreSQL.
  
• Leverage PySpark on Azure Databricks to process massive datasets and integrate them with other services like Logic Apps for automation.