Quality Assurance Specialist

Role & Responsibilities

• Deliver quality assurance for Sierra Agentic AI chatbot and Service Cloud chat channels.
• Perform functional, regression and integration testing across chat workflows.
• Conduct end-to-end testing of AI agent conversational flows.
• Perform AI/chatbot-specific testing, including hallucination detection and validation.
• Validate response accuracy and intent matching.
• Test edge cases and adversarial inputs.
• Validate conversation flow integrity and fallback behavior.
• Develop and maintain test automation.
• Improve test coverage and reduce manual testing efforts.
• Ensure production readiness and provide QE sign-off for releases.

Preferred Candidate Profile

• 68+ years of experience in QA / Software Testing.
• Mandatory: Hands-on Sierra Agentic AI chatbot testing experience.
• Strong experience in AI/Chatbot and conversational AI testing.
• Experience with functional, regression, integration and end-to-end testing.
• Experience testing AI agent responses, conversational flows and fallback scenarios.
• Knowledge of hallucination detection, response accuracy and intent validation.
• Experience with edge-case and adversarial testing.
• Strong test automation experience.
• Experience with Service Cloud/Salesforce chat testing is preferred.
• Immediate or early joiners preferred.
• Candidates should be based in Bangalore or willing to work 3 days from Manyata Tech Park.