Team Lead, Quality Assurance - 1
Infor Global Solution · Hyderabad · onsite · Posted 1d ago
Undisclosed8–10 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Required Qualifications:
- Bachelors degree in Computer Science, Information Technology, Engineering, or related field. 8-10 years of experience in software quality assurance with at least 3 years in a lead or principal QA role.
- Proven experience leading QA for an AI or data-intensive product in production - not just familiarity with concepts but hands-on ownership of quality outcomes.
- Deep understanding of RAG system testing - search relevance validation, embedding quality assessment, hybrid search behaviour, and corpus quality measurement.
- Strong experience with multi-agent or distributed system testing - tracing failures across service boundaries, validating inter-agent contracts, and verifying execution ordering.
- Experience building and maintaining automated test suites in Python, with the ability to define quality frameworks from scratch rather than inheriting them.
- Solid understanding of LLM evaluation methodologies and tools such as RAGAS, DeepEval, or equivalent - with the ability to select and adapt them to non-standard evaluation problems.
- Experience with REST API contract testing and integration testing across multi-service architectures.
- Experience with at least one major cloud platform: AWS (Preferred), Azure, or GCP.
- Strong communication and stakeholder management skills - ability to translate quality findings into clear risk assessments for engineering leadership and product teams.
A Day in the Life Typically Includes:
- Define and own the overall QA strategy for AI Studio - covering search relevance, multi-agent coordination, schema validation, tenant isolation, and LLM output quality.
- Lead a team of QA engineers, assign test coverage areas, review test plans, and ensure quality gates are met before each release.
- Collaborate with the AI Studio architecture team, component teams, and FDEs to understand new features, contribution model changes, and agent updates - translating these into test requirements.
- Drive the design of evaluation frameworks for non-deterministic Orchestrator outputs - defining what "correct" means for gap maps, dependency graphs, and blueprint quality across varying user inputs.
- Oversee search relevance regression testing - ensuring that as the knowledge corpus grows, existing query-result quality does not degrade.
- Define and enforce tenant isolation testing standards, ensuring no cross-tenant data leakage across sessions, project history, or search results.
- Report quality metrics to engineering leadership - solution generation success rates, clarification round counts, agent failure rates, and corpus coverage gaps.
Infors AI Studio represents an agentic platform that enables teams to author, configure, and deploy Infor OS and ERP solutions utilizing natural language processing capabilities. We are seeking an Lead Quality Assurance Engineer to join the AI Studio team and lead the QA team to thoroughly validate the agent architecture of AI Studio. The testing will spread across components like ION, Data Fabric, Birst, EPM, RPA/IDP, CSD, and Portal. This initiative constitutes a strategic priority for Infor, designed to accelerate velocity suite sales, enhance customer experience, and facilitate more effective collaboration between Cutomers and Sevices, FDEs, Partners and SCs
We are seeking a Team Lead for Quality Assurance to lead the testing efforts to deliver high quality software solutions across our cloud product portfolio.
We are seeking a Team Lead for Quality Assurance to lead the testing efforts to deliver high quality software solutions across our cloud product portfolio.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
Sourced from naukri
Skills
schemasoftware quality assurancesystem testingRegression TestingPythonERPStakeholder ManagementIntegration TestingComputer ScienceInformation Technology
About Infor Global Solution
Infor Global Solution
Software Product
4.5k+
employees
2002
24 years old
New York, New York
India
₹12.3L PA avg
Avg at Infor Global Solution
About
Infor Global Solution is a simplified ERP preconfigured to be industry-specific for fast implementation on a platform with cloud security.
Industries
Software ProductInternetManufacturingRetail
Employee ratings
10 reviews
3.9/ 5
Culture
3.5
Career growth
2.8
Work-life
3.9
Employees rate it well for
Work-Life Balance42Job Security41
Find them on