1. Home
  2. Jobs
  3. Jobs in Mumbai
  4. Backend Developer jobs in Mumbai
  5. Senior Backend Developer
Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 23166819

    Deloitte logo

    Senior Backend Developer

    Deloitte · Mumbai · onsite · Posted 3d ago

    Not disclosed4–7 yrsfulltimeSourced fromInstahyre

    About a minute. You'll make an account on the way through.

    About this role

    Roles & Responsibilities:

    • Lead the design and development of agentic and intelligent systems with strong ownership of core algorithms, model behavior, and decision logic, minimizing reliance on managed AI services and abstraction-heavy frameworks.
    • Architect end-to-end agentic systems with deep control over model internals, reasoning flows, tool-use logic, and execution pipelines rather than wrapper-based orchestration.
    • Take algorithmic and model-level ownership of agent behavior, including reasoning strategies, planning algorithms, fallback logic, and failure handling.
    • Design and implement custom agent orchestration, memory systems, context management, and stateful workflows without over-dependence on LangChain/LangGraph-style abstractions.
    • Build and fine-tune open-source and self-hosted LLMs or hybrid approaches (open-weight + proprietary) based on performance, cost, and security trade-offs.
    • Develop custom RAG pipelines, embedding strategies, ranking, re-ranking, and grounding mechanisms tailored to enterprise knowledge systems.
    • Integrate agentic solutions with enterprise applications, APIs, data platforms, and internal ML systems.
    • Establish low-level design patterns, reusable libraries, and internal frameworks for building agent-based systems from first principles.
    • Optimize model inference, reasoning efficiency, latency, cost, and response quality, including prompt-free and programmatic reasoning approaches where applicable.
    • Drive Responsible AI practices with in-house guardrails, explainability techniques, auditability, and governance controls.
    • Collaborate with business stakeholders to translate complex requirements into deterministic, reliable agent-driven solutions, avoiding black-box dependencies.
    • Lead production support, deep debugging, RCA, and performance tuning at both system and model levels.
    • Mentor junior consultants on core AI concepts, algorithms, and system design, not just framework usage.


    Education:

    • BE / B.Tech in Computer Science, Engineering, or a related discipline.


    Required Experience & Skills.:

    • 4 to 7 years of strong experience building AI-driven systems, with demonstrated ownership of model behaviour and algorithms, not just API integration.
    • Deep understanding of agentic architectures, multi-agent coordination, autonomous decision-making systems, and custom orchestration approaches.
    • Ability to design agent frameworks from scratch or significantly extend existing ones rather than relying on out-of-the-box abstractions.
    • Strong understanding of LLM internals, transformer architectures, inference behavior, tokenization, attention, and trade-offs.
    • Experience with open-source LLMs (e.g., LLaMA-family, Mistral, Mixtral, Falcon, Qwen) and self-hosted deployments.
    • Advanced reasoning strategies: chain-of-thought alternatives, tree/graph-based reasoning, planners, critic-agent loops, and tool reasoning.
    • Prompting as a controlled technique, not the primary abstraction.
    • Experience with LangChain, LangGraph, AutoGen, CrewAI as reference tools, with proven ability to bypass, customize, or replace them with custom implementations.
    • Preference for code-first, algorithm-driven approaches over declarative or black-box pipelines.
    • Deep experience in RAG pipelines, embeddings, vector similarity search, hybrid retrieval, reranking models, and knowledge grounding.
    • Strong grasp of information retrieval, indexing, and retrieval algorithms.
    • Strong systems engineering skills with Python and/or Java/Go for AI backends.
    • Experience deploying AI workloads on GCP, including self-managed inference, GPUs, containers, and scaling strategies.
    • Familiarity with MLOps practices: model versioning, evaluation pipelines, controlled rollouts, and experimentation.
    • Deep experience in AI observability: tracing reasoning paths, latency profiling, quality evaluation, and cost monitoring.
    • Strong understanding of AI security, data privacy, access control, and compliance, with preference for in-house controls over managed tooling.
    • General Insurance (Health, Motor, Travel) domain knowledge is a strong advantage.


    Soft Skills:

    • Demonstrates strong ownership mindset, curiosity at the algorithmic level, and comfort working with ambiguity and complex systems.
    • Collaborates effectively across engineering, data science, and business teams, clearly explaining technical trade-offs and design decisions.
    • Exhibits professional integrity, reliability, and clear, respectful communication with stakeholders.

    Sourced from instahyre

    Skills

    IndexingRetrieval Augmented GenerationLlamaEmbeddingsLarge Language Models (LLMs)MistralGolangretrievalMixtralPythonrerankingFalconJava

    About Deloitte

    Deloitte logo

    Deloitte

    Management Consulting

    120k+

    employees

    1845

    181 years old

    Hyderabad, India

    US

    About

    At Deloitte, we help provide high-quality audit & assurance services, consulting, tax, and advisory services to some of the world’s most admired brands. Alongside this work, our Enabling Areas and Global teams support Deloitte’s businesses, helping create impact for clients, communities, and our people. Our professionals help provide measurable and lasting results that could help reinforce public trust in capital markets, enable clients to transform and thrive, and lead the way toward a stronger economy, a more equitable society and a sustainable world. Building on its 180-plus year history, Deloitte spans more than 150 countries and territories.


    Deloitte US‑India Offices (USI) is a region within the Deloitte US organization, with offices across seven cities in India: Hyderabad, Mumbai, Gurugram, Bengaluru, Kolkata, Pune, and Chennai.

    Industries

    Management ConsultingIT Services & ConsultingAccounting & Auditing

    Employee ratings

    23,234 reviews

    3.7/ 5

    Culture

    3.6

    Career growth

    3.1

    Work-life

    3.2

    Employees rate it well for

    Work Life Balance4379Work Culture3091Salary2235Learning1870Senior Management1457

    Find them on

    WebsiteLinkedInAmbitionBox reviews

    See all 117 Backend Developer jobs in MumbaiBackend Developer jobs in IndiaJobs in Mumbai

    Career guides

    • Resume keywords for software engineers in India (with examples by role)
    • myjobb vs Simplify (2026): autofill extension or full AI job agent?
    • myjobb vs Standout (2026): AI job agent vs startup career agent

    All career guidesAll articlesBrowse companies hiring

    Senior Backend Developer · waiting for your command