1. Home
  2. Jobs
  3. Jobs in Bangalore
  4. Legal jobs in Bangalore
  5. RC-REGULATORY COMPLIANCE-AI-Senior
Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 23861461

    Ernst Young logo

    RC-REGULATORY COMPLIANCE-AI-Senior

    Ernst Young · Bengaluru · onsite · Posted today

    Undisclosed5–10 yrsfulltimeSourced fromNaukri

    About a minute. You'll make an account on the way through.

    About this role

    EY- GDS Consulting Enterprise Risk (ER) Regulatory Compliance Senior GxP AI/Model Evaluation Consultant

    The Opportunity
    We are seeking a highly experienced and detailoriented AI Model Evaluation Consultant with strong expertise in validating AI/ML models, Generative AI (GenAI) systems, and multiagent workflows within GxP regulated and qualitycritical environments. The ideal candidate will ensure the reliability, fairness, robustness, and regulatory compliance of AI solutions while supporting crossfunctional teams in designing, testing, and maintaining productionready, inspectionready AI systems.
    This role is responsible for leading AI model evaluation and validation activities across the full model lifecycle, including model development, training, testing, deployment, and postdeployment monitoring, in alignment with GxP principles, riskbased validation, and data integrity expectations. The consultant will play a key role in embedding Responsible AI, qualitybydesign, and governancebydesign practices, enabling the safe, trustworthy, and explainable use of AI and agentbased solutions in regulated life sciences and pharmaceutical contexts.


    Your key responsibilities
    • Support development of AI/ML and Agentic AI strategies by providing analysis, validation insights, and readiness assessments.
    • Perform AI/ML model evaluation and validation across development, training, testing, and deployment phases.
    • Evaluate model performance using precision, recall, accuracy, F1score, and confusion matrices.
    • Assess model behavior across datasets, edge cases, and failure scenarios to identify bias, drift, and instability.
    • Demonstrate strong understanding of supervised and unsupervised learning models, including classification, regression, clustering, and anomaly detection.
    • Conduct handson evaluation of GenAI and LLMbased systems, including prompt behavior, response quality, and consistency.
    • Design and execute testing strategies for AI agents and multiagent workflows, covering orchestration logic, tool invocation, and output validation.
    • Use LangChain, LangGraph, and Langfuse for agent workflows, observability, traceability, and evaluation logging.
    • Collaborate with data scientists and engineers to identify model improvement opportunities and risk mitigations.
    • Document evaluation results, limitations, risks, and acceptance criteria in a clear, auditready manner.


    Qualifications
    • Bachelors or masters degree in Life Sciences, Engineering, or related field.
    • 5+ years of experience in AI/ML, GenAI, software testing, validation, or quality engineering roles.
    • Experience creating user stories, test scripts, validation plans, or AI solution prototypes.
    • Exposure to cloud ecosystems such as Azure, AWS, or GCP.
    • Consulting or clientfacing experience preferred.
    • Excellent communication, documentation, and stakeholder management skills.


    Must-Have Skills And Attributes
    • Strong understanding of ML models, LLMs, GenAI workflows, agentic systems, and evaluation techniques.
    • Strong foundation in machine learning concepts and model evaluation techniques.
    • Handson experience with: Precision, Recall, Confusion Matrix, ROC/AUC, Supervised and Unsupervised ML models
    • Practical experience with LangChain, LangGraph, and Langfuse.
    • Experience evaluating GenAI / LLMbased applications and agents.
    • Strong documentation, analytical, and stakeholder communication skills.
    • Experience designing test cases, user stories, and acceptance criteria for AI/MLbased systems.
    • Ability to validate AI outputs, evaluate accuracy, detect bias, and assess model reliability under varied conditions.
    • Handson skills in building prototypes, test harnesses, and demo environments.
    • Strong stakeholder management, analytical thinking, and structured communication skills.
    • Familiarity with version control, prompt engineering fundamentals, and AIassisted testing tools is preferred.
    • Strong knowledge of GxP regulations (FDA 21 CFR Part 11, EU Annex 11)
    • GAMP 5 methodology and system development life cycle (SDLC)
    • CSV documentation: URS, FRS, IQ/OQ/PQ, Traceability Matrix, Validation Plans
    • Understanding of data integrity principles and electronic records/e-signatures compliance
    • Ability to collaborate with cross-functional teams (QA, IT, Manufacturing, Labs)
    • Experience in client-facing roles, managing expectations and delivering solutions
    • Strong communication and presentation skills
    • Experience in IT project management and validation planning
    • Ability to troubleshoot application issues and recommend solutions
    • Familiarity with change control, deviation handling, and CAPA processes
    • Proven ability to mentor junior staff and lead validation teams
    • Experience in training and cross-skilling resources
    • Strong teamwork and collaboration mindset


    Good-to-Have Skills And Attributes
    • Exposure to business development activities and client engagement strategies
    • Ability to create innovative insights and contribute to thought leadership
    • Understanding of market trends and competitor landscape

    Sourced from naukri

    Skills

    Cfrclusteringai modelamazon web servicesclassificationCSVCAPAChange ControlAnomaly DetectionCapital MarketsdeploymentBusiness DevelopmentcloudCommunication SkillsBusiness TransformationcomplianceAi SolutionsMicrosoft AzureArtificial Intelligence

    About Ernst & Young

    Ernst Young logo

    Ernst Young

    Management Consulting

    44k+

    employees

    2002

    24 years old

    Gurgaon / Gurugram, Haryana

    India

    ₹15.3L PA avg

    Avg at Ernst & Young

    About

    At EY, our purpose is Building a better working world. The insights and quality services we provide help build trust and confidence in the capital markets and in economies the world over.

    Industries

    Management Consulting

    Employee ratings

    10 reviews

    3.4/ 5

    Culture

    1.9

    Career growth

    2.3

    Work-life

    2.5

    Employees rate it well for

    Job Security36Skill Development35

    Find them on

    WebsiteLinkedInAmbitionBox reviews

    See all 219 Legal jobs in BangaloreLegal jobs in IndiaJobs in Bangalore

    Career guides

    • Can employers tell if you used AI? An honest answer for India
    • AI job agent vs job board vs auto-apply bot: what's the difference?
    • AI Bots That Fill Job Applications and Answer Screening Questions (2026): 8 Tools Compared on CTC, Notice Period and Knockout Questions

    All career guidesAll articlesBrowse companies hiring

    RC-REGULATORY COMPLIANCE-AI-Senior · waiting for your command