1. Home
  2. Jobs
  3. Jobs in Bangalore
  4. Mechanical Engineer jobs in Bangalore
  5. Lead Quality Engineer
Agent
Jobs
Applied
Tracker
Profile
    1. Jobs for you
    2. Job

    Job · 23906375

    Brillio logo

    Lead Quality Engineer

    Brillio · Bengaluru · onsite · Posted 5d ago

    Not disclosed4–6 yrsfulltimeSourced fromInstahyre

    About a minute. You'll make an account on the way through.

    About this role

    Job requirements:

    • With at least 4 to 6 years of experience in quality engineering, including hands-on testing and evaluation of AI-powered product applications and microservices


    Key Responsibilities:

    • Develop and execute robust evaluation frameworks for AI agents, focusing on Responsible AI and safety metrics such as bias, toxicity, and alignment failures
    • Design synthetic testing environments and simulation strategies to stress-test agents under diverse real-world conditions
    • Implement adversarial testing, red-teaming, and prompt injection methodologies to identify vulnerabilities and ensure agent robustness
    • Integrate evaluation pipelines into CI/CD workflows for continuous quality assurance and rapid iteration
    • Collaborate with policy and legal teams to ensure agent evaluations meet regulatory compliance and ethical standards
    • Analyze evaluation results and provide actionable insights to development teams, prioritizing safety and risk mitigation
    • Configure and execute automated test suites using Python and relevant AI/ML testing libraries (e.g., PyTest, DeepEval, Ragas, Giskard)
    • Manage bug detection, documentation, and tracking using Jira, focusing on performance degradations and alignment failures


    Required Skills:

    • Python programming
    • PyTest
    • DeepEval
    • Ragas
    • Giskard
    • Langsmith
    • Google Agent Development Kit (ADK)
    • Vertex AI
    • Safety evaluations (red teaming, adversarial testing)
    • Prompt injection testing
    • API testing for AI/ML systems
    • Data analysis with Pandas and SQL


    Preferred Skills:

    • Gemini models
    • Hugging Face
    • Garbage-in/Garbage-out (GIGO) testing tools
    • Data poisoning techniques
    • AI ethics principles and policy background
    • Visualization tools for evaluation results


    Desired Qualifications:

    • Bachelor's degree in Computer Science, Artificial Intelligence, Information Technology, or Software Engineering
    • ISTQB Foundation Level certification or Certified Software Tester (CST)
    • Certification in AI/ML testing or Responsible AI (e.g., Google Cloud Certified - Professional Machine Learning Engineer)

    Sourced from instahyre

    Skills

    pytestRed TeamingAdversarial TestingPython

    About Brillio

    Brillio logo

    Brillio

    IT Services & Consulting

    3.7k+

    employees

    2014

    12 years old

    Dallas, US state of Texas

    CU

    About

    Brillio offers comprehensive digital transformation services, focusing on customer experience, AI, and product engineering to drive business innovation.

    Industries

    IT Services & ConsultingAnalytics & KPO

    Employee ratings

    1,318 reviews

    3.4/ 5

    Culture

    3.2

    Career growth

    2.8

    Work-life

    3.4

    Employees rate it well for

    Work Life Balance203Senior Management169Salary115Work Culture114Learning109

    Find them on

    WebsiteLinkedInAmbitionBox reviews

    See all 371 Mechanical Engineer jobs in BangaloreMechanical Engineer jobs in IndiaJobs in Bangalore

    Career guides

    • Can Recruiters Tell If You Used Auto-Apply? 9 Signals They See in the ATS (2026)
    • 8 best LazyApply alternatives for 2026, ranked for India
    • myjobb vs Tsenta (2026): honest review, tested for India

    All career guidesAll articlesBrowse companies hiring

    Lead Quality Engineer · waiting for your command