Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, load data from various sources into Azure Databricks.
• Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business needs.
• Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Synapse.
• Create reports using Power BI to provide insights on processed data.

Job Requirements :

• 5-8 years of experience in a similar role as a Data Engineer or related field.
• Strong understanding of Azure Data Factory (ADF), Azure Databricks, Azure Synapse, Fabric/SQL concepts.
• Experience working with big-data technologies such as Hadoop/Hive/Pyspark etc.