Senior Data Architect Databricks

Senior Data Architect – Databricks

About the Role

We are looking for a Senior Data Architect to join a high-impact enterprise data engineering team focused on building scalable, cloud-based data platforms using Databricks.

In this role, you will work closely with strategic customers to design, implement, and deploy modern data and AI solutions. You will own technical architecture, large-scale data migrations, production deployments, and customer engagements while also mentoring junior engineers.

Key Responsibilities

• Design and implement end-to-end data architectures using Databricks and cloud technologies.
• Lead large-scale data migrations to and from Databricks.
• Work directly with customers to understand requirements and translate them into scalable technical solutions.
• Build reference architectures, technical documentation, and how-to guides.
• Guide customers through the design, development, deployment, and adoption of Databricks-based data and AI solutions.
• Develop and productionize large-scale data engineering and analytics applications.
• Collaborate with Project Managers, Architects, Engagement Managers, and customer teams to ensure successful technical delivery.
• Provide technical guidance and support for complex production issues.
• Manage technical scope, timelines, and delivery for customer projects.
• Apply best practices around CI/CD, MLOps, security, scalability, and performance.
• Mentor and guide junior data engineers and technical team members.
• Conduct technical discussions, architecture sessions, and whiteboarding with customers and internal stakeholders.
• Travel up to 30%, based on customer requirements.

Required Skills & Experience

• 6+ years of experience in data engineering, data platforms, and analytics.
• Strong hands-on experience with Databricks and enterprise data platforms.
• Mandatory: Databricks certification.
• Proven experience with large-scale data migrations to/from Databricks.
• Deep expertise in Apache Spark, including Spark architecture and runtime internals.
• Strong programming experience in Python or Scala.
• Experience with at least two major cloud platforms — AWS, Azure, or GCP — with deep expertise in at least one.
• Experience designing and deploying high-performance, scalable end-to-end data architectures.
• Hands-on experience deploying and integrating Databricks-based solutions in production.
• Working knowledge of CI/CD and MLOps.
• Experience managing technical projects, scope, timelines, and delivery.
• Strong documentation, presentation, and whiteboarding skills.
• Proven customer-facing / consulting experience with external clients.
• Strong stakeholder management and conflict-resolution skills.
• Excellent communication, collaboration, and problem-solving abilities.