Databricks Data Engineer

Job Description – Databricks Data Engineer

Role: Databricks Data Engineer Long term Contract

Experience: 4–6 Years

Location: Pune Job Summary We are seeking an experienced

Databricks Data Engineer with 4–6 years of expertise in designing, developing, and optimizing modern data engineering solutions. The ideal candidate will have strong hands-on experience with

Databricks ,

SQL , ETL pipeline development, backend data engineering, Patient Data Foundation setup, and Data Quality (DQ) framework development. You will play a key role in building scalable, high-performance data pipelines that enable enterprise analytics and business intelligence. Key Responsibilities

• Design, develop, and maintain scalable data engineering solutions using

Databricks .

• Build and optimize robust ETL/ELT pipelines for processing structured and unstructured data.
• Develop and support

Patient Data Foundation (PDF) architecture and data integration.

• Design and implement

Data Quality (DQ) frameworks to ensure data accuracy, consistency, and reliability.

• Write, optimize, and troubleshoot complex SQL queries for data transformation and reporting.
• Perform data validation, testing, and production support for data pipelines.
• Collaborate with data architects, business analysts, and cross-functional teams to deliver high-quality data solutions.
• Optimize data processing performance and ensure scalability of data platforms.
• Participate in code reviews, deployment activities, and continuous process improvements.
• Follow data governance, security, and engineering best practices. Required Skills
• 4–6 years of experience in Data Engineering.
• Strong hands-on experience with

Databricks (

Mandatory ).

• Strong SQL programming and query optimization skills (

Mandatory ).

• Experience building scalable ETL/ELT pipelines.
• Experience in backend data development.
• Knowledge of Patient Data Foundation setup.
• Experience developing and implementing Data Quality (DQ) frameworks.
• Experience in testing and validating data pipelines.
• Strong analytical, debugging, and problem-solving skills. Preferred Skills
• Experience with Apache Spark and PySpark.
• Exposure to Azure Databricks or cloud-based data platforms.
• Experience in Healthcare or Life Sciences domain.
• Knowledge of Azure Data Factory, Delta Lake, or data warehousing concepts.
• Familiarity with Agile development methodologies. Mandatory Skills
• Databricks
• SQL
• ETL/ELT Pipeline Development
• Backend Data Engineering
• Patient Data Foundation Setup
• Data Quality (DQ) Framework Development
• Data Testing Good to Have
• PySpark
• Azure Databricks
• Delta Lake
• Azure Data Factory
• Healthcare/Life Sciences Domain

Experience: 4–6 Years

Open Positions: 2

Location: Pune