Databricks Data Engineer

We are looking for a skilled

Databricks Data Engineer to design, build, and optimize scalable data pipelines on the

Databricks Lakehouse platform . The ideal candidate should have strong expertise in

Spark, Delta Lake, and cloud data engineering , with experience in building enterprise-grade data solutions.

Key Responsibilities

• Design, develop, and maintain

scalable data pipelines using

Databricks (PySpark/SQL)

• Implement

ETL/ELT workflows for structured and unstructured data

• Build and optimize

Delta Lake tables (partitioning, Z-ordering, performance tuning)

• Develop data solutions on

Azure platforms

• Work with

data ingestion frameworks (ADF, Auto Loader, APIs)

• Implement

data quality, validation, and governance frameworks

• Optimize jobs for

performance, cost, and reliability

• Collaborate with

data scientists, analysts, and business teams

• Ensure compliance with

data security & regulatory standards (e.g., PII/HIPAA where applicable)

• Work with

CI/CD pipelines and DevOps practices for deployment

Required Skills

• Strong experience in

Databricks Lakehouse Platform

• Proficiency in

PySpark, Spark SQL

• Hands-on experience with

Delta Lake

• Strong SQL and data modeling skills
• Experience with

cloud platforms (Azure preferred: ADLS, ADF, Synapse)

• Knowledge of

data pipeline orchestration (Databricks Workflows / Airflow)

• Experience with

data ingestion (batch & streaming)

• Understanding of

partitioning, indexing, and query optimization

• Familiarity with

Git, CI/CD pipelines Good to Have

• Experience with

Unity Catalog & data governance

• Knowledge of

MLflow or MLOps workflows

• Databricks certifications (

Associate/Professional ) Please fill the form Databricks Data Engineer – Fill out form