1. Home
  2. Jobs
  3. Jobs in Bangalore
  4. AI / ML jobs in Bangalore
  5. Senior AI Engineer Azure AI Foundry
Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 23296804

    AV

    Senior AI Engineer Azure AI Foundry

    Avanade · Bengaluru · onsite · Posted 13d ago

    Not disclosed6–8 yrsfulltimeSourced fromFoundit

    About a minute. You'll make an account on the way through.

    About this role

    Experience

    6 – 8 years

    Level

    Senior

    Location

    Delhi / Mumbai / Bangalore (India)

    Employment Type

    Full-time

    Primary Skills

    Azure AI Foundry, RAG, AI Agents, AI / ML

    Role Summary

    We are seeking a Senior AI Engineer to design and deliver scalable Generative AI and agentic solutions on Azure AI Foundry. You will own the technical design of RAG systems and AI agents, drive quality and performance, mentor junior engineers, and work directly with client stakeholders to translate business problems into reliable AI solutions.

    Key Responsibilities

    • Design and implement production-grade RAG architectures using Azure AI Foundry, Azure OpenAI, and Azure AI Search (hybrid search, semantic ranking, re-ranking, metadata filtering).
    • Architect and build single- and multi-agent systems using Azure AI Foundry Agent Service, Semantic Kernel, LangGraph, or AutoGen, including tool integration, memory, and orchestration.
    • Define and implement evaluation frameworks for RAG and agents (groundedness, relevance, safety, latency, cost) and drive continuous improvement.
    • Optimize LLM solutions for cost, latency, and accuracy: prompt optimization, caching, model selection, fine-tuning where appropriate.
    • Design and build ML models and pipelines (training, validation, deployment, monitoring) using Azure Machine Learning or equivalent.
    • Implement LLMOps / MLOps practices: CI/CD, model and prompt versioning, observability, and automated testing.
    • Apply responsible AI practices: content safety, PII handling, guardrails, access control, and auditability.
    • Lead technical design discussions, review code and architecture, and mentor engineers on the team.
    • Engage with client stakeholders to understand requirements, estimate effort, and present technical solutions.

    Required Skills & Experience

    • 6 – 8 years of total experience in software / data / AI engineering, with at least 2 – 3 years delivering Generative AI solutions in production.
    • Strong, hands-on expertise in Azure AI Foundry, including model deployments, agents, evaluations, tracing, and content safety.
    • Proven experience designing and shipping RAG systems at scale, including advanced retrieval strategies and evaluation.
    • Proven experience building AI agents (tool calling, planning, multi-agent orchestration) using Azure AI Foundry and at least one agent framework.
    • Solid AI/ML background: model development, hyperparameter tuning, evaluation, deployment; experience with PyTorch / TensorFlow / scikit-learn; NLP / transformer fundamentals.
    • Expert-level Python; experience building scalable APIs and microservices.
    • Strong Azure experience: Azure OpenAI, AI Search, Azure ML, Functions, Container Apps / AKS, Cosmos DB, Key Vault, API Management, Application Insights.
    • Hands-on experience with MLOps / LLMOps tooling and CI/CD (Azure DevOps or GitHub Actions).
    • Experience mentoring junior engineers and leading small delivery teams.

    Qualifications

    Good to Have

    • Azure certifications (AI-102, DP-100, AZ-305).
    • Experience with fine-tuning (LoRA / PEFT), model distillation, or small language models.
    • Experience with Model Context Protocol (MCP) and enterprise tool integrations.
    • Experience with Microsoft Fabric, Databricks, or Synapse for data engineering.
    • Experience with Infrastructure as Code (Bicep / Terraform).

    Soft Skills

    • Strong stakeholder communication and client-facing presentation skills.
    • Ability to break down ambiguous problems and drive them to delivery.
    • Mentoring and team-building mindset.

    Education

    B.E. / B.Tech / M.E. / M.Tech / MCA / M.Sc in Computer Science, Data Science, AI/ML, or a related field.

    Sourced from foundit

    Skills

    AimlApi ManagementAzure DevopsAzure AI FoundryMLOpsAksKey VaultCosmos DBNatural Language ProcessingLLMOpsazure mlAzure OpenAIGithub ActionsApplication InsightsAzure AI SearchRAG SystemsPytorchTensorflowScikit-LearnContainer AppsPythonGenerative Ai

    See all 551 AI / ML jobs in BangaloreAI / ML jobs in IndiaJobs in Bangalore

    Career guides

    • Best AI Job Search Tools for Experienced Professionals (2026): For Senior, Lateral and Leadership Moves
    • Best AI job search tools in India (2026): 15 compared on auto-apply, resumes and referrals
    • Tailor your resume to a job description with AI: a 4-step method

    All career guidesAll articlesBrowse companies hiring

    Senior AI Engineer Azure AI Foundry · waiting for your command