Databricks Architect

Position: Databricks Architect

Purpose of the Position:

To lead the design, development, and implementation of scalable data solutions using Databricks on cloud platforms. The role involves architecting data pipelines, optimizing performance, and ensuring data governance and security across enterprise-level analytics initiative

s
Key Result Areas and Activities

• :
  Architecture Design: Develop and maintain scalable, secure, and high-performance data architecture using Databric
• ks.Data Pipeline Development: Lead the creation and optimization of ETL/ELT pipelines for structured and unstructured da
• ta.Cloud Integration: Ensure seamless integration of Databricks with cloud platforms like Azure, A
• WS.Performance Optimization: Monitor and enhance the performance of data workflows and Spark jo
• bs.Stakeholder Collaboration: Work closely with data engineers, analysts, and business stakeholders to translate requirements into technical solutio

ns.
Must Have Ski

• lls
  Strong expertise in Apache Spark and Databricks plat
• form.Hands-on experience with Python or Scala for data engineering t
• asks.Good expertise in Gen AI/LLM automation/modernization proj
• ects.Proficiency in SQL for data manipulation and quer
• ying.Hands on experience and awareness about latest features in databricks like AI/BI Genie, Agentbricks, Databricks
• Apps.Experience with Delta Lake, Lakehouse architecture, and data versio
• ning.Knowledge of CI/CD pipelines and DevOps practices in data enginee
• ring.Familiarity with cloud platforms (Azure/AWS) and their data serv
• ices.Understanding of data governance, security, and compliance framew
• orks.Contribute to presales and

RFPs.
Good To Have

• Skill
  Experience with MLflow and machine learning model depl
• oyment.Knowledge of Apache Airflow or other orchestration
• tools.Exposure to real-time data processing using Kafka or similar
• tools.Familiarity with Power BI, Tableau, or other BI
• tools.Certification in Databricks or relevant cloud techno