Databricks Architect - Security SME

Role Overview

Job Title: Databricks Architect - Security SME. Experience Level: 6 - 8 Years. Location: Pune/remote. Employment Type: Full-Time. We are seeking a highly skilled Databricks Architect to act as our primary Subject Matter Expert (SME) for data platform security. In this role, you will lead the design, implementation, and governance of a highly secure, enterprise-grade Databricks environment. You will be responsible for ensuring absolute isolation between the control and data planes, designing robust access policies, and advising engineering teams on best practices for storage and compute security.

Key Responsibilities

• Architecture Design: Design and implement a scalable, bulletproof security layer for enterprise Databricks environments across Azure Platform.
• Network Isolation: Architect and manage strict Data Plane and Control Plane isolation. Implement secure network topologies including VNet/VPC injection, Private Link, and IP access lists.
• Access Management (IAM): Develop, deploy, and govern comprehensive Role-Based Access Control (RBAC) policies and Access Control Lists (ACLs) for users, groups, and service principals.
• Data Protection Privacy: Design and enforce data security policies using Databricks Unity Catalog, including dynamic data masking, row-level security (RLS), and column-level security.
• Storage Security: Advise on and implement best practices for storage isolation (e.g., secure ADLS Gen2 / AWS S3 bucket configurations, IAM roles, and storage credentials).
• Advisory Governance: Serve as the central SME for Databricks security. Establish security guardrails, conduct regular platform audits, and mentor data engineering teams on secure coding and deployment practices.
• Automation: Collaborate with DevSecOps teams to automate the provisioning of secure Databricks workspaces and infrastructure using Terraform or other IaC tools.

Required Skills Qualifications

• Experience: 6 to 8 years in Data Architecture, Data Engineering, or Cloud Security, with a minimum of 3+ years specifically focused on Databricks administration and architecture.
• Databricks Expertise: Deep, hands-on understanding of Databricks architecture, specifically regarding the separation of the Control Plane and Data Plane.
• Unity Catalog: Proven experience deploying and managing Databricks Unity Catalog for unified governance and data access control.
• Security Deep Dive: Mastery of RBAC, fine-grained ACLs, data masking, encryption (in transit and at rest), and credential management (e.g., Databricks Secrets, Azure Key Vault, AWS Secrets Manager).
• Cloud Networking: Strong background in cloud networking and identity management (Azure AD/Entra ID, AWS IAM) and how they integrate with Databricks.
• Scripting/Coding: Proficiency in SQL and Python for managing platform APIs and automating administrative tasks.
• Preferred Databricks certifications: Databricks Certified Platform Administrator

Nice to Have

• Cloud security certifications (e.g., AWS Certified Security - Specialty, Azure Security Engineer Associate).
• Experience implementing Infrastructure as Code (IaC) using Terraform for secure workspace deployments.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.