Azure Databrick Lead

Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Databricks.
  
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
  
• Develop complex SQL queries to optimize database performance and troubleshoot issues.
  
• Implement machine learning models using PySpark on Spark clusters.
  
• Ensure seamless integration of Azure services such as Data Factory, Synapse Analytics, and Logic Apps.
  

Desired Candidate Profile

• 6-11 years of experience in designing and developing big data solutions using Azure Databricks.
  
• Strong expertise in working with PySpark on Spark clusters.
  
• Proficiency in writing complex SQL queries for query optimization and troubleshooting purposes.
  
• Experience with implementing machine learning models using PySpark is an added advantage.