Databricks Architect UK Insurance

Databricks Architect – UK Insurance

Location: Hyderabad/Pune

Experience: 10+ Years

Employment Type: Full-time

Key Responsibilities

• Design and architect enterprise-scale data solutions using Databricks and cloud data platforms.
• Lead the design and implementation of Lakehouse architecture, Delta Lake, data pipelines, and data processing frameworks.
• Develop scalable data engineering solutions using Apache Spark, PySpark, SQL, and related technologies.
• Work closely with business, data engineering, and architecture teams to translate requirements into technical solutions.
• Define data ingestion, transformation, integration, governance, security, and performance strategies.
• Establish best practices for data quality, monitoring, optimization, and CI/CD.
• Provide technical leadership and mentorship to data engineering teams.
• Ensure solutions comply with relevant UK Insurance industry data, security, and regulatory requirements.
• Participate in architecture reviews, technical discussions, and solution design activities.

Required Skills

• 10+ years of experience in data engineering, data architecture, or related technology roles.
• Strong hands-on experience with Databricks and Apache Spark.
• Excellent knowledge of PySpark and SQL.
• Strong understanding of Delta Lake and Lakehouse architecture.
• Experience with cloud platforms, preferably Microsoft Azure.
• Experience designing enterprise data pipelines and data integration solutions.
• Strong understanding of data modeling, data governance, security, and performance optimization.
• Experience with CI/CD, Git, and DevOps practices.
• Excellent communication, stakeholder management, and problem-solving skills.

Domain Experience

Mandatory: UK Insurance domain experience.

Good understanding of insurance business processes, data, and terminology.

Experience working with insurance-related data such as policy, claims, customer, underwriting, billing, and risk is preferred.

Knowledge of UK insurance regulations and industry practices is an advantage.

Preferred Qualifications

Databricks certifications are a plus.

Azure certifications are preferred.

Experience with Azure Data Factory, ADLS, Azure DevOps, or similar Azure services.

Experience in large-scale enterprise transformation or modernization programs.