Technical Databricks Lead

Role:

We are seeking an experienced Databricks Lead to lead the design, development, and delivery of scalable data engineering solutions using the Databricks Lakehouse Platform. The candidate should have strong hands-on expertise in PySpark, Python, SQL, Delta Lake, and cloud technologies, along with the ability to lead technical teams and deliver enterprise-grade data solutions.

Required Skills & Qualifications

• Extensive experience in data engineering with hands-on Databricks production experience.
• Strong expertise in Databricks, Delta Lake, Unity Catalog, and Spark SQL.
• Proficiency in PySpark, Python, and advanced SQL.
• Experience designing ETL/ELT pipelines and implementing Medallion architecture.
• Knowledge of Azure (ADLS, ADF), AWS (S3, Glue), or GCP.
• Experience with CI/CD, Git, performance tuning, and data governance.
• Proven ability to lead teams, conduct code reviews, mentor engineers, and manage end-to-end delivery.

Preferred Skills

• Databricks Certified Data Engineer Professional certification.
• Experience with Kafka, Spark Structured Streaming, and real-time data processing.
• Familiarity with Power BI, Tableau, and workflow orchestration tools.
• Experience with Agile methodologies and production support.