1. Home
  2. Jobs
  3. Jobs in Pune
  4. AI / ML jobs in Pune
  5. AI / LLM Engineer
Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 22488204

    Infosys logo

    AI / LLM Engineer

    Infosys · Pune · onsite · Posted today

    Undisclosed10–18 yrsfulltimeSourced fromNaukri

    About a minute. You'll make an account on the way through.

    About this role

    Job Description
    As an AI / LLM Engineer, you will build the AI-enabled capabilities that support summaries, narratives, explanations, recommendations, retrieval, evaluation and governed human review experiences across an enterprise platform.
    You will work closely with architects, product teams, data engineers, backend engineers, security, QA and domain specialists to convert AI patterns into production-ready software components.


    Roles Responsibilities
    Design and implement LLM-powered workflows for summarization, narrative generation, classification, extraction, contextual reasoning, explanation and reviewer-assist use cases.
  1. Build retrieval-augmented generation pipelines including document ingestion, chunking, embedding generation, metadata tagging, vector indexing, retrieval tuning and grounded response generation.
  2. Develop reusable prompt templates, prompt versions, context builders, response schemas, evaluation routines and AI orchestration services.
  3. Integrate with enterprise AI services such as Azure OpenAI, Azure AI Foundry, OpenAI APIs, Google Gemini, Anthropic, Hugging Face or equivalent approved platforms.
  4. Implement AI run logging, prompt/model metadata capture, evidence citations, output traceability, reviewer feedback capture and human-in-the-loop controls.
  5. Build AI evaluation routines for answer quality, retrieval quality, hallucination checks, regression testing, consistency and groundedness.
  6. Collaborate with backend and DevOps teams to containerize AI services, deploy them securely, monitor usage, track costs and troubleshoot production issues.
  7. Support responsible AI practices such as prompt injection checks, data leakage prevention, policy-based guardrails and AI output validation.


    Technical Requirement
    Minimum 10+ years of experience in software engineering, AI/ML engineering, applied ML, data science engineering or related roles.
  8. Strong hands-on Python programming experience and practical exposure to LLM-based application development.
  9. Experience with RAG, vector databases, embeddings, prompt engineering, evaluation frameworks and AI service integration.
  10. Experience with frameworks such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, CrewAI or equivalent tools.
  11. Working knowledge of REST APIs, microservices, SQL, structured data concepts, Git workflows, testing and software engineering practices.
  12. Understanding of document extraction, semantic search, NLP, retrieval quality, hallucination risk, prompt safety and AI evaluation methods.
  13. Ability to build production-oriented AI components rather than isolated proof-of-concept demos.


    Additional Responsibility
    Experience with Azure OpenAI, Azure AI Foundry, Azure AI Search, Azure Document Intelligence, Google AI Studio/Gemini, AWS Bedrock or Vertex AI.
  14. Exposure to RAG evaluation tools such as RAGAS, DeepEval, Promptfoo, LangSmith or equivalent frameworks.
  15. Experience with AI governance, prompt/model registry, AI audit logs, explainability, groundedness checks and human review workflows.


    Educational Requirement
    Master Of Engineering,Bachelor of Engineering


    Preferred Skills
    Technology->AI-Agentic AI->Agent Engineering,Technology->AI-AI Engineering->AI/ML Solution Architecture and Design->traditional ai ml,Technology->AI-Data science->AI-Data science,Technology->AI-Machine Learning->ML Platform,Technology->AI-Machine Learning->Responsible AI


    Service Line
    Global Delivery
  16. Sourced from naukri

    Skills

    DevopsBedrockAI evaluationCrewaiAzure Aiapisai servicesaws bedrockamazon web servicesclassificationgeminiAzure OpenAIai governanceEmbeddingsFoundryArchitectureApplication DevelopmentMicrosoft AzureGITData ScienceArtificial IntelligenceAnthropic SDK

    About Infosys

    Infosys logo

    Infosys

    IT Services & Consulting

    323.6k+

    employees

    1981

    45 years old

    Bengaluru/Bangalore, Karnataka

    India

    About

    Infosys is a global leader in next-generation digital services and consulting.

    Industries

    IT Services & ConsultingConsulting

    Employee ratings

    48,765 reviews

    3.5/ 5

    Culture

    3.6

    Career growth

    2.6

    Work-life

    3.6

    Employees rate it well for

    Salary10252Work Life Balance6251Work Culture5404Learning4530Appraisal3780

    Find them on

    WebsiteLinkedInAmbitionBox reviews

    See all 125 AI / ML jobs in PuneAI / ML jobs in IndiaJobs in Pune

    Career guides

    • AI Bots That Fill Job Applications and Answer Screening Questions (2026): 8 Tools Compared on CTC, Notice Period and Knockout Questions
    • How to Build a Job Application Automation in 2026: Architecture, ATS APIs and Code - and When to Buy Instead
    • Best AI Job Agents in 2026: 8 Compared on What They Actually Automate (India + Global)

    All career guidesAll articlesBrowse companies hiring

    AI / LLM Engineer · waiting for your command