Azure Databricks, Python, SQL, ADF, Synapse

Role & responsibilities

Azure Databricks Developer Python, SQL, ADF & Synapse

Location: Bangalore

Experience: 8+ Years

Employment Type: Full-Time

Preferred candidate profile

Job Summary

We are looking for an experienced Azure Databricks Developer with strong expertise in Python, SQL, Azure Data Factory (ADF), and Azure Synapse Analytics to design, develop, and maintain scalable data engineering solutions on the Azure Cloud platform. The ideal candidate will have hands-on experience building data pipelines, ETL processes, and data warehouse solutions to support business analytics and reporting requirements.

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Databricks and ADF.

Build and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data.

Develop data transformation logic using Python, PySpark, and SQL.

Create and manage Azure Synapse Analytics solutions for enterprise data warehousing.

Integrate data from multiple sources including databases, APIs, and cloud storage.

Monitor, troubleshoot, and optimize data processing jobs for performance and reliability.

Implement data quality, governance, and security best practices.

Collaborate with business stakeholders, architects, and analysts to understand data requirements.

Support production deployments and resolve data-related issues.

Document technical designs, processes, and solutions.

Required Skills

4+ years of experience in Data Engineering and Azure Data Platform technologies.

Strong hands-on experience with:

Azure Databricks

Python / PySpark

SQL

Azure Data Factory (ADF)

Azure Synapse Analytics

Expertise in ETL/ELT development and data pipeline architecture.

Experience with Azure Data Lake Storage (ADLS Gen2).

Strong understanding of data warehousing concepts and dimensional modeling.

Experience in performance tuning and optimization of Spark jobs.

Knowledge of Git, CI/CD pipelines, and DevOps practices.

Familiarity with data security and governance standards.

Preferred Skills

Experience with Delta Lake and Lakehouse architecture.

Knowledge of Azure Functions and Logic Apps.

Experience working with real-time/streaming data.

Azure Data Engineer Associate (DP-203) certification.

Experience with Power BI integration and reporting solutions.