Technical Lead-AI QA
BirlaSoft · Bengaluru · onsite · Posted 62d ago
Undisclosed7–12 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Area(s) of responsibility
AI QA Engineer - Agentic AI / GenAI
QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with strong Python expertise.
Key Responsibilities- Develop Python-based automation frameworks (Pytest)
- Test LLM outputs (accuracy, hallucination, relevance)
- Validate multi-agent workflows and pipelines
- Build evaluation metrics (F1, precision, recall)
- Perform API and integration testing
- Ensure high test coverage and CI/CD integration
- Strong Python programming
- Automation frameworks (Pytest/unittest)
- Understanding of GenAI/LLMs
- API testing and debugging
- CI/CD and version control
7 years or more in QA experience, exposure to GenAI/ML systems
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
QATestingAutomationtechnical leadProgrammingdebuggingPythonAPI TestingIntegration TestingGIT
About Birlasoft
BirlaSoft
IT Services & Consulting
10.9k+
employees
1995
31 years old
Pune, Maharashtra
India
About
Birlasoft combines the power of a domain, enterprise, and digital technologies to reimagine business potential. Surpassing expectations, breaking convention!
Industries
IT Services & Consulting
Employee ratings
3,764 reviews
3.4/ 5
Culture
3.3
Career growth
2.6
Work-life
3.6
Employees rate it well for
Work Life Balance532Salary397Senior Management376Work Culture319Appraisal309
Find them on