Tosca QA Testing

Key Responsibilities
Manual Testing
Understand business requirements and acceptance criteria.
Create test scenarios and test cases.
Perform end-to-end testing across multiple systems.
Execute functional, integration, regression, smoke, and UAT testing.
Validate data flow and business processes.
Identify, log, and retest defects.
Prepare test evidence and test execution reports.

Automation Testing
Develop and maintain automated test scripts using:
TOSCA
Automate regression and repetitive test scenarios.
Execute automation suites and analyze results.
Maintain automation frameworks and reusable components.
Support CI/CD testing activities where applicable.
Work with development teams to improve test coverage and quality.
AI & Agent Testing
Test AI-powered applications and conversational agents.
Validate AI responses against expected business outcomes.
Test prompts, agent workflows, and user interactions.
Verify agent actions and integrations with external systems.
Test happy paths, negative scenarios, and edge cases.
Identify hallucinations, incorrect responses, and unexpected AI behavior.
Validate data security, access controls, and compliance requirements.
Support testing of single-agent and multi-agent solutions.

Required Skills
Testing Skills
Strong experience in Manual Testing.
Experience in End-to-End Testing.
Good understanding of Functional, Integration, Regression, and UAT Testing.
Experience in defect management using Azure DevOps or Jira.

Automation Skills
Hands-on experience with:
TOSCA
Experience in automation framework development and maintenance.
Knowledge of API testing is an advantage.

AI Testing Knowledge
Basic understanding of Artificial Intelligence concepts.
Understanding of Generative AI applications.
Basic knowledge of AI Agent architecture and workflows.
Understanding of prompt testing and AI response validation.
Ability to identify incorrect, biased, or inconsistent AI responses.
Experience Required
4 to 8 years of QA Testing experience.
Experience in both Manual and Automation Testing.
Exposure to AI Testing or Agent Testing is preferred.
Experience working in Agile teams.
Preferred Skills
Knowledge of Microsoft Copilot Studio, AI Agents, MS365
Experience with Power Platform applications is a plus.