Data Architect (Azure Databricks)

Azure Databricks Architect

Location

Chennai / Bengaluru / Hyderabad / Nagpur / Pune

Experience

10+ Years in Data Engineering, Cloud Architecture, and Big Data Technologies

Job Summary

We are seeking an experienced Azure Databricks Architect to lead the design, implementation, and optimization of enterprise-scale data and analytics platforms on Microsoft Azure. The ideal candidate will possess deep expertise in Azure Databricks, data lake architecture, ETL/ELT frameworks, cloud-native data solutions, and modern analytics platforms. This role will partner with business stakeholders, data engineers, data scientists, and solution architects to deliver scalable, secure, and high-performing data ecosystems.

Key Responsibilities

Architecture & Design

• Design and implement end-to-end data platforms leveraging Azure Databricks and Azure-native services.
• Define scalable Lakehouse architectures using Delta Lake and Medallion Architecture principles.
• Establish enterprise data models, governance frameworks, and security standards.
• Create architecture blueprints, technical roadmaps, and solution design documents.
• Drive cloud modernization and data migration initiatives.

Data Engineering & Analytics

• Design and optimize large-scale data ingestion, transformation, and orchestration pipelines.
• Develop batch and real-time streaming solutions using Databricks Structured Streaming.
• Implement data integration solutions using:
• Azure Data Factory (ADF)
• Azure Synapse Analytics
• Event Hubs
• Azure Functions
• Azure Storage Services
• Enable advanced analytics, AI, and machine learning workloads on Databricks.

Platform & Governance

• Implement data governance, lineage, cataloging, and access control strategies.
• Leverage Unity Catalog for centralized data governance.
• Establish CI/CD and DevOps practices for data engineering projects.
• Define monitoring, alerting, performance tuning, and cost optimization strategies.
• Ensure compliance with enterprise security and regulatory requirements.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field.
• 10+ years of experience in Data Engineering and Data Architecture.
• 5+ years of hands-on experience with Azure Databricks.
• Experience designing and deploying enterprise-scale cloud data platforms.
• Strong understanding of security, governance, and data compliance frameworks.

Preferred Certifications

• Microsoft Certified: Azure Solutions Architect Expert
• Microsoft Certified: Azure Data Engineer Associate
• Databricks Certified Data Engineer Professional
• Databricks Certified Solution Architect
• Databricks Certified Machine Learning Professional