Senior Databricks Expert – Genie Specialist

Senior Databricks Expert – Genie Specialist

Location: Gurgaon (Hybrid / In-office)

Experience: 6–9 Years

Employment Type: Full-Time Job Overview We are looking for a

Senior Databricks Expert (Genie Specialist) with strong experience in

Databricks, Unity Catalog, Delta Lake, SQL, and AI-driven data intelligence platforms . The ideal candidate will be responsible for designing, implementing, and optimizing

Databricks Genie solutions that enable business users to interact with enterprise data using natural language. You will play a key role in building AI-powered data experiences by creating well-structured data models, improving text-to-SQL accuracy, and ensuring secure, governed access to enterprise data. This role requires a strong understanding of

Lakehouse architecture, semantic data modeling, metadata optimization, and GenAI-driven analytics solutions . Key Responsibilities Databricks Genie Implementation & Optimization

• Design, configure, and manage

Databricks Genie Spaces for different business domains.

• Optimize Genie performance by improving data context, metadata quality, and query accuracy.
• Configure business-friendly natural language interfaces for enterprise analytics use cases.
• Analyze Genie conversation logs and continuously improve text-to-SQL accuracy. Semantic Data Modeling & Data Preparation
• Design and optimize Gold layer datasets to support accurate AI-driven data discovery.
• Create business-friendly schemas, tables, metadata descriptions, and trusted data assets.
• Build semantic models that improve Genie understanding and reduce query ambiguity.
• Define reusable SQL assets and query templates for complex business scenarios. SQL & Query Optimization
• Develop advanced SQL queries to validate and optimize Genie-generated responses.
• Troubleshoot incorrect SQL outputs caused by complex joins, relationships, or business logic.
• Create optimized views, functions, and trusted assets to improve query reliability.
• Perform SQL performance tuning across large-scale Databricks environments. Unity Catalog & Data Governance
• Implement enterprise-grade governance using

Databricks Unity Catalog .

• Configure and manage:
• Row-level security
• Column-level security
• Data access policies
• Data lineage
• Ensure Genie solutions comply with enterprise security and governance standards. Automation & Platform Integration
• Automate Databricks configurations and metadata management using:
• Databricks REST APIs
• Databricks SDK (Python)
• Python automation scripts
• Develop reusable frameworks for managing Genie spaces, metadata, and data assets.
• Support scalable deployment practices across multiple environments. GenAI Data Architecture
• Design Lakehouse architectures optimized for AI and natural language analytics.
• Improve AI response accuracy through:
• Better metadata definitions
• Context engineering
• Trusted assets
• Business-specific Genie configurations
• Collaborate with data engineering, analytics, and AI teams to deliver intelligent data solutions. Required Skills & Qualifications
• 6–9 years of experience in Data Engineering, Data Platforms, or AI Data Architecture.
• Strong hands-on experience with:
• Databricks Genie
• Databricks Unity Catalog
• Delta Lake
• SQL
• Lakehouse architecture
• Deep understanding of semantic data modeling for AI/GenAI applications.
• Advanced SQL skills including:
• Complex joins
• Query optimization
• Data validation
• Query refactoring
• Experience building trusted datasets and business-ready data models.
• Strong understanding of metadata management and data governance.
• Experience with Python automation and Databricks APIs/SDK. Preferred Skills
• Experience implementing AI-powered analytics platforms.
• Understanding of Large Language Model (LLM) concepts and text-to-SQL systems.
• Experience optimizing AI data retrieval workflows.
• Knowledge of PySpark and Databricks notebooks.
• Experience working with enterprise-scale cloud data platforms. Ideal Candidate Profile The ideal candidate should be able to:
• Build and scale Databricks Genie solutions across business teams.
• Improve natural language analytics accuracy through strong data modeling.
• Design secure and governed AI-ready data platforms.
• Bridge the gap between business users, data engineering teams, and AI solutions.

Work Location: Gurgaon

Work Mode: Hybrid / In-office