Data Engineering Analyst

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, load data from various sources into Azure Databricks.
• Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business objectives.
• Develop complex SQL queries to optimize database performance and troubleshoot issues in Microsoft Azure databases.
• Ensure high availability of critical applications by implementing monitoring tools such as Prometheus or Grafana.

Job Requirements :

• 3-5 years of experience in Data Engineering with expertise in ADF, Azure Databricks, PySpark, and Microsoft Azure.
• Strong understanding of big data technologies including Hadoop ecosystem components like Hive or Spark.
• Experience working on cloud-based platforms such as AWS or GCP is a plus but not mandatory.