LLM Engineer

Job Title: LLM Scientist
Experience: 4+ Years
Location: Pune/Nagpur (Work From Office)

Job Summary:

We are looking for an experienced LLM Scientist to research, prototype, and evaluate advanced Generative AI and Agentic AI systems. The role involves LLM fine-tuning, RAG architecture, statistical experimentation, model evaluation, and Python-based GenAI development.

Key Responsibilities

• Design and prototype Agentic AI and multi-agent systems.
• Build and improve RAG pipelines using chunking, embeddings, hybrid search, and reranking.
• Fine-tune LLMs using LoRA/QLoRA.
• Conduct model, prompt, architecture, A/B, and ablation experiments.
• Build evaluation and benchmarking frameworks for GenAI systems.
• Analyze groundedness, hallucination, relevance, and retrieval quality.
• Apply statistical methods and classical machine learning techniques.
• Research emerging LLM and Agentic AI technologies.
• Collaborate with engineering teams to transition prototypes into production.

Mandatory Skills

• 4+ years of experience in LLM, Machine Learning, NLP, or Generative AI.
• Strong Python programming skills.
• Strong understanding of LLMs, Transformers, and Generative AI fundamentals.
• Hands-on experience with Agentic AI, RAG, and LLM fine-tuning.
• Proficiency in LangChain and LangGraph.
• Working knowledge of MCP (Model Context Protocol).
• Experience with LoRA/QLoRA fine-tuning.
• Experience with vector databases such as FAISS, ChromaDB, or Pinecone.
• Understanding of embeddings, chunking, hybrid search, and reranking.
• Strong knowledge of statistics, probability, hypothesis testing, and confidence intervals.
• Experience with ML evaluation metrics such as Precision, Recall, F1, and ROC-AUC.
• Experience evaluating hallucination, groundedness, relevance, and retrieval quality.

Good to Have

• Knowledge of BERT, NLP, sentiment analysis, XGBoost, or anomaly detection.
• Research background or publications in NLP/LLMs.
• Experience working in regulated enterprise domains.
• B.Tech/M.Tech in Computer Science, IT, or a related field.