Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 15938604

    Zensar Technologies logo

    AI Architect Quality Intelligence

    Zensar Technologies · Pune · onsite · Posted 46d ago

    Not disclosed15–17 yrsfulltimeSourced fromFoundit

    About a minute. You'll make an account on the way through.

    About this role

    What You Will Do

    Experience Range - 15 Yrs +

    • Architect and evolve the platform suite
    • Design and refine the archetype-specific assurance lifecycles
    • Keep the platforms LLM-agnostic and deployable on any client stack — on-prem, cloud or hybrid — as model-mixing and constant provider churn become the market norm.
    • Own technical roadmap decisions for accelerators such as the Agentic Foundry (a 25-blueprint reference matrix) and the curated, swap-ready tooling ecosystem around each archetype.

    Lead Evaluation-Driven Development

    • Build and govern eval suites — ground-truth Q&A sets, LLM-as-judge rubrics, frozen baselines — that gate every release rather than validate it after the fact.
    • Own trajectory grading, red/purple/blue-team probes and safety attestations for agentic and generative systems, and drift monitoring and fairness audits for classical ML.
    • Translate evaluation results into release decisions: eval-threshold gates, red-team severity floors, canary and shadow deployments, and rollback rehearsals.
    • Bring evaluation-driven development practice into client engagements — showing, not just telling, how a live harness beats a one-time audit.

    Own Presales and Client Proposals

    • Respond to RFPs, RFIs and client proposals across both engines, translating client requirements into a defensible solution architecture and commercial structure.
    • Architect engagements across the full ladder — AI QA Assessment, AI QA Transformation, Managed AI QA — and fast-starts such as the LLM Health Check, Agent Stress Test and Compliance Sprint.
    • Build estimates, staffing plans and technical win themes that hold up under client and internal scrutiny, across client-managed, risk-reward and Zensar-managed commercial models.

    Present and Articulate Value to Clients

    • Lead client workshops and technical walkthroughs, including guiding a CIO through the Agentic Foundry in a single session.
    • Build and deliver executive trust scorecards and portfolio risk heat maps that make the assurance story board-ready.

    Build Practice IP and Mentor the Next Generation

    • Contribute reusable accelerators, reference architectures and industry packs across BFSI, TMT, and Manufacturing & Retail back into the practice's IP base.
    • Mentor and help build out the practice's emerging AI-specialist roles — Prompt Engineer, LLM-Eval Engineer, Agent Architect, Trajectory Eval Engineer, Knowledge/RAG Engineer, AI Security Analyst and Adversarial Red/Blue Team Lead.

    Sourced from foundit

    Skills

    Evaluation-driven developmentfairness auditsExecutive trust scorecardsLLM-as-judge rubricsReusable acceleratorsSafety attestationsTechnical roadmap decisionsTrajectory gradingSolution architectureClient Engagementreference architecturesclient workshopsdrift monitoring

    About Zensar Technologies

    Zensar Technologies logo

    Zensar Technologies

    IT Services & Consulting

    10.0k+

    employees

    2001

    25 years old

    Pune, Maharashtra

    India

    About

    Zensar is a global organization that conceptualizes, builds, and manages digital products through experience design, data engineering, and advanced analytics for leading companies.

    Industries

    IT Services & Consulting

    Employee ratings

    2,994 reviews

    3.7/ 5

    Culture

    3.5

    Career growth

    3.0

    Work-life

    3.8

    Employees rate it well for

    Work Life Balance442Work Culture366Senior Management300Salary295Job Security229

    Find them on

    WebsiteLinkedInAmbitionBox reviews

    AI Architect Quality Intelligence · waiting for your command