Azure Databricks Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Azure Databricks to support business intelligence initiatives.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions that meet customer needs.
• Develop complex SQL queries to extract insights from massive datasets stored in Azure Blob Storage and Azure Data Lake Store.
• Troubleshoot issues related to data processing, query performance tuning, and system configuration.

Job Requirements :

• 6-12 years of experience in designing and developing big data solutions on Microsoft Azure platform.
• Strong expertise in working with PySpark for ETL processes.
• Experience with US Healthcare industry knowledge is an added advantage.