AI/ML Tester ( automation. manual tester )

Criteria:

• 5+ yrs of testing experience in both Manual & automation
• Should have minimum 1 year of experience in AI/ML testing
• Good Communication skills
• NP: Max 15 days
• Location: Chennai
• Interviews 2 rounds
• 1st RD Virtual & 2nd RD mandatory f2f
• Shift timings: 12 to 9pm & 5 days working from office.
  

Job Description

 Owns technical testing of agent outputs accuracy, turnaround-time impact, and regression testing as agents are iterated feeding the accuracy and completion-time KPIs tracked at the programmer level.

 Key Responsibilities:

• Build test suites validating agent outputs against golden-record datasets across covered processes.
• Track and report accuracy/turnaround-time metrics to support baselining exercises agreed with the business.
• Run regression testing whenever agent/prompt configurations change, to prevent silent accuracy drift in regulated processes.
• Feed findings into the human QA function for final sign-off this role supports human QA authority on regulated activity with technical evidence, not replaces it.

Required Experience:

• 5+ years QA/test engineering experience, ideally including ML/LLM output validation (not just deterministic software testing).
• Hands-on experience on working in Real-time project experience in Agentic AI or Generative AI applications.
• Experience with API testing and tools such as Postman.
• Experience with load and performance testing like Jmeter.
• Experience using any of the for defect tracking and management tool like Azure DevOps (ADO) .
• Ability to evaluate AI responses for accuracy, relevance, completeness, consistency, and hallucinations.
• Experience defining test datasets and accuracy benchmarks for document/text-processing systems.
• Domain process familiarity a plus for building realistic test scenarios.