AI Engineer (Gen AI, Databricks)

Responsibilities :

Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks. Build and optimize ETL/ELT workflows for structured and unstructured data. Develop and deploy Generative AI solutions using LLMs. Implement RAG (Retrieval-Augmented Generation) architectures and vector databases. Work with large-scale datasets using Spark and PySpark. Integrate AI solutions with cloud services and enterprise applications. Collaborate with Data Scientists, Data Engineers, and business stakeholders. Monitor, troubleshoot, and optimize data and AI workloads. Ensure data quality, governance, and security standards. Mandatory Skills 2-5 years of experience in Data Engineering and/or GenAI Databricks PySpark / Apache Spark Python SQL Data Pipeline Development ETL/ELT Development Delta Lake Data Warehousing Concepts Generative AI LLMs (OpenAI, Azure OpenAI, Llama, Claude, etc.) RAG Frameworks Vector Databases Git

Additional Responsibilities:

Preferred Skills Azure Databricks or AWS Databricks LangChain / LangGraph Azure OpenAI MLflow Kafka Airflow Snowflake DBT Knowledge of MLOps concepts Good to Have Prompt Engineering Agentic AI Semantic Search REST APIs Docker CI/CD Exposure

Technical and Professional Requirements:

Gen Ai + Databricks (with Data Engineering exp is preferred)