Lead Developer - Databricks

About the Role

We are seeking an experienced Team Lead - Databricks Applications to lead a team of developers building production-grade applications on the Databricks platform. You will drive technical decisions, mentor engineers, and ensure delivery of enterprise-ready solutions.

What you will do

1. Architect and design production applications on the Databricks platform
2. Drive technical decisions on application patterns, security, and performance
3. Build and optimise data pipelines using Databricks Workflows and Delta Lake
4. Establish coding standards, best practices, and code review processes
5. Configure Unity Catalogue for data governance and access management
6. Oversee cloud security, service principals, and permissions strategy
7. Own application monitoring, performance tuning, and cost optimisation
8. Lead and mentor a team of 1-2 Databricks developers
9. Collaborate with stakeholders to translate requirements into technical solutions
10. Participate in Agile ceremonies and contribute to sprint planning and delivery

You'll need to have:

1. 8+ years of hands-on experience building production applications on Databricks or comparable cloud data platforms
2. 2+ years of experience in a technical leadership role
3. Expert-level Python and SQL development skills
4. Strong experience with REST API and web application development
5. Deep expertise in Databricks Apps, Workflows, Unity Catalog, and Delta Lake
6. Experience with compute management and performance optimization at scale
7. Strong understanding of cloud security, identity management, and service principals
8. Track record of turning prototypes into production-ready enterprise applications
9. Excellent communication and stakeholder management skills
10. Bachelor's or master's degree in computer science or related field

Preferred Qualifications

1. Experience with CI/CD pipelines and Git workflows
2. Familiarity with infrastructure as code (Terraform, ARM templates)
3. Automated testing strategies (unit, integration, end-to-end)
4. Frontend development experience with React
5. Databricks certifications (Data Engineer Associate, Platform Administrator)