Testing - AI Test Lead Senior
Ernst Young · Bengaluru · onsite · Posted 44d ago
Undisclosed5–10 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Position Title: QE AI Test Lead
The Opportunity As a QE AI Test Lead, you will be responsible for validating AI models and systems including Narrow AI, Generative AI, and Agentic AI. The role involves performing data validation, model evaluation, and statistical analysis while collaborating closely with data scientists to ensure comprehensive testing coverage.
You will also identify anomalies in data and outputs, assess model bias, and ensure that privacy and compliance protocols are strictly adhered to during testing activities.
Your Key Responsibilities - Define and own test strategy, planning, execution, and reporting for AI-based systems
- Conduct AI model validation across functional, performance, and statistical metrics
- Perform data validation activities including data collection, augmentation, exploratory analysis, bias detection, and privacy assessment
- Identify discrepancies, anomalies, and risks in model outputs and ensure timely resolution with development teams
- Lead defect management and collaborate with cross-functional teams for resolution
- Engage with client stakeholders to provide status updates and resolve issues
- Prepare test reports and support sign-off and closure activities
- Lead distributed teams across geographies and ensure delivery excellence
- Strong understanding of AI/ML concepts, LLMs, and Agentic AI systems
- Hands-on experience in AI testing techniques such as bias testing, drift testing, metamorphic testing, and back-to-back testing
- Expertise in test automation tools (e.g., Selenium, Playwright, PyTest)
- Proficiency in Python programming and AI evaluation frameworks
- Exposure to GitHub Copilot or similar AI-assisted development tools
- Good understanding of cloud platforms such as Azure, AWS, or GCP
- Strong analytical, problem-solving, and communication skills
- Experience working in Agile environments
Sourced from naukri
Skills
AutomationAgileAI evaluationcloud platformsai modelsdata privacyai modelamazon web servicescopilotAnalyticsCapital MarketsAI testingcloudData CollectionCommunication SkillsAccountingcomplianceData ValidationMicrosoft AzureArtificial Intelligence
About Ernst & Young
Ernst Young
Management Consulting
44k+
employees
2002
24 years old
Gurgaon / Gurugram, Haryana
India
₹15.3L PA avg
Avg at Ernst & Young
About
At EY, our purpose is Building a better working world. The insights and quality services we provide help build trust and confidence in the capital markets and in economies the world over.
Industries
Management Consulting
Employee ratings
10 reviews
3.4/ 5
Culture
1.9
Career growth
2.3
Work-life
2.5
Employees rate it well for
Job Security36Skill Development35
Find them on