Gen AI Databricks Architect with Mosaic AI
Celebal Technologies · Hyderabad · onsite · Posted 51d ago
Undisclosed3–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
skills:["Databricks","Mosaic AI","LLMs","MLflow","Prompt Engineering","Lakehouse Architecture"] , responsibilities:[" GenAI Architecture & Development
- Architect end-to-end GenAI solutions including RAG (Retrieval-Augmented Generation), AI agents, and fine-tuned models on Databricks.
- Evaluate and select appropriate LLMs (OpenAI, Anthropic Claude, Azure OpenAI, DBRX, Llama, Mistral) based on use case requirements and cost optimization.
- Design and implement scalable vector search solutions using Databricks Vector Search and Mosaic AI.
- Establish prompt engineering best practices, optimization techniques, and prompt management strategies.
- Implement compound AI systems and multi-agent architectures using Databricks Agent Framework.
- Design and implement GenAI solutions leveraging Databricks Mosaic AI capabilities including Model Serving, Foundation Model APIs, Vector Search, AI Gateway, and Feature & Function Serving.
- Architect data pipelines using Delta Lake and Spark for preprocessing, chunking, and embedding generation at scale.
- Implement robust data governance using Unity Catalog for model assets, features, and vector indices.
- Design and manage MLflow experiments for LLM evaluation, tracking, and model registry.
- Design LLMOps pipelines for evaluation, monitoring, A/B testing, and continuous improvement.
- Implement guardrails, safety measures, content filtering, and responsible AI practices.
- Build observability solutions for LLM applications including latency monitoring, cost tracking, and quality metrics.
- Establish CI/CD pipelines for GenAI model deployment using Databricks Workflows and Asset Bundles.
- Lead technical decisions and conduct architecture reviews for GenAI initiatives.
- Collaborate with business stakeholders to translate requirements into scalable technical solutions.
- Mentor engineers and data scientists on GenAI development standards and Databricks best practices.
- Create technical documentation, reference architectures, and reusable solution accelerators.
- Experience with open-source LLMs (Llama, Mistral, Mixtral, Phi)
- Knowledge of LLM evaluation frameworks (RAGAS, DeepEval, custom evaluation pipelines)
- Experience with multi-modal models (GPT-4o)
- Background in agentic AI, tool use, and function calling
- Experience with knowledge graphs and graph-based RAG
- Databricks Certified Data Engineer or ML Professional certification
- Cloud architecture experience (Azure preferred; AWS/GCP acceptable)
- Experience with Azure OpenAI Service and Azure AI Foundry
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
Continuous improvementSolution ArchitectOpen sourcegoogle cloud platformMonitoringTechnical DocumentationdeploymentContent FilteringArchitectureData Governance
About Celebal Technologies

Celebal Technologies
Software Product
2.0k+
employees
2016
10 years old
Jaipur, Rajasthan
IN
₹8.4L PA avg
Avg at Celebal Technologies
About
Celebal Technologies specializes in data science, delivering advanced data solutions to enhance business efficiency and decision-making across industries.
Industries
Software Product
Employee ratings
10 reviews
3.1/ 5
Culture
2.1
Career growth
1.8
Work-life
2.5
Employees rate it well for
Skill Development35Work-Life Balance31
Find them on