About a minute. You'll make an account on the way through.
About this role
Job Summary
Responsibilities
Requirements
Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
We are looking for an experienced Lead Data Engineer to help shape, build and operate scalable data solutions on the Databricks platform. This is a hands-on leadership role for someone who can set technical direction, mentor engineers and deliver robust, secure and high-performing data pipelines, Lakehouse solutions and analytics-ready data products.
You will work closely with data engineers, analysts, data scientists, architects, product owners and business stakeholders to translate complex requirements into practical, reliable and scalable data services. You will bring strong technical judgement, a passion for engineering excellence and the ability to promote best practice across data engineering, governance and platform operations.
At Arup, you belong to an extraordinary collective - in which we encourage individuality to thrive. Our strength comes from how we respect, share and connect our diverse experiences, perspectives and ideas. You will have the opportunity do socially useful work that has meaning - to Arup, to your career, to our members and to the clients and communities we serve.
Responsibilities
- Lead, mentor and support a team of data engineers, setting technical direction and encouraging engineering best practice.
- Design, build and operate scalable data pipelines and Lakehouse solutions using Databricks, Apache Spark, Delta Lake and cloud-native services.
- Define standards for ingestion, transformation, orchestration, testing, deployment, observability and monitoring.
- Collaborate with cross-functional teams to turn business and technical requirements into high-quality data solutions.
- Champion reusable frameworks, automation, medallion architecture patterns and modern data engineering practices.
- Embed data quality, security, governance and compliance controls across pipelines and data products.
- Review solution designs, code and deployment approaches to maintain consistency, resilience and operational reliability.
- Optimise Databricks workloads for performance, scalability and cost efficiency.
- Support Agile delivery, sprint planning, estimation, continuous improvement and technical roadmap development.
Requirements
- Strong production experience in Databricks, Spark, PySpark, SQL and Delta Lake.
- Experience designing scalable data pipelines, Lakehouse solutions and cloud-native data services.
- Knowledge of Unity Catalog, data governance, security and access control patterns.
- Confidence leading, mentoring and developing data engineers.
- A passion for engineering excellence, automation, reliability and continuous improvement.
Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
data qualityAutomationAgileApache SparkData EngineerCommunity Engagementdata servicesApacheAgile DeliveryAnalyticsdeploymentDatabricksData EngineeringcloudArchitectureData GovernancecomplianceData Pipeline
About ARUP
ARUP
Engineering & Construction
311
employees
1946
80 years old
London, London
GB
₹19.6L PA avg
Avg at ARUP
About
We guide, plan and design the future of the built environment. We are a global consultancy with advisory and technical expertise across more than 150 disciplines.
Industries
Engineering & ConstructionArchitecture & Interior Design
Employee ratings
0 reviews
3.7/ 5
Employees rate it well for
Job Security40Work-Life Balance39
Find them on