AI Testing SDET

Your Key Responsibilities

• Define and own test strategy, planning, execution, and reporting for AI-based systems
• Conduct AI model validation across functional, performance, and statistical metrics
• Perform data validation activities including data collection, augmentation, exploratory analysis, bias detection, and privacy assessment
• Identify discrepancies, anomalies, and risks in model outputs and ensure timely resolution with development teams
• Lead defect management and collaborate with cross-functional teams for resolution
• Engage with client stakeholders to provide status updates and resolve issues
• Prepare test reports and support sign-off and closure activities
• Lead distributed teams across geographies and ensure delivery excellence

Skills and attributes for success

• Strong understanding of AI/ML concepts, LLMs, and Agentic AI systems
• Hands-on experience in AI testing techniques such as bias testing, drift testing, metamorphic testing, and back-to-back testing
• Expertise in test automation tools (e.g., Selenium, Playwright, PyTest)
• Proficiency in Python programming and AI evaluation frameworks
• Exposure to GitHub Copilot or similar AI-assisted development tools
• Good understanding of cloud platforms such as Azure, AWS, or GCP
• Strong analytical, problem-solving, and communication skills
• Experience working in Agile environments