AI QA Engineer
TESTRIQ · Mumbai · onsite · Posted 8d ago
Undisclosed2–4 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Responsibilities
Requirements
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
- Design and execute test plans specifically for AI/ML features and LLM-integrated product workflows
- Evaluate model outputs for accuracy, consistency, edge cases, hallucinations, and bias
- Build and maintain automated evaluation pipelines and regression benchmarks
- Run prompt testing, adversarial testing, and structured red-teaming exercises
- Define quality metrics and release criteria for AI-driven features
Requirements
- 2-4 years in software QA or SDET roles, with at least 1 year on AI/ML products
- Hands-on experience testing LLM-based features or AI APIs
- Proficiency in Python and testing frameworks (pytest, unittest)
- Familiarity with prompt engineering and evaluation techniques
- Experience with CI/CD pipelines and automated test infrastructure
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
QAqa engineerCI/CD PipelinesAI evaluationworkflowsapisregressionpytestTesting FrameworksSDETLarge Language Models (LLMs)Software QAPythonArtificial IntelligenceMachine Learning