Lead I - Software Testing

Job Summary

UST is looking for a highly skilled QA Engineer with expertise in functional and automation testing, API validation, AI-output evaluation, and quality assurance for modern cloud-native applications. The ideal candidate will play a critical role in ensuring product quality, supporting end-to-end testing activities, and validating AI-driven solutions, including RAG-based systems.

The Opportunity

As a QA Engineer, you will be responsible for planning, designing, executing, and automating test scenarios across web applications, APIs, and AI-powered solutions. You will collaborate with product owners, developers, business stakeholders, and DevOps teams to ensure high-quality software releases and exceptional user experiences.

Responsibilities

• Define and execute comprehensive test strategies, test plans, and test cases based on business and technical requirements.
• Ensure requirements traceability and maintain defect lifecycle management using Jira.
• Perform functional, integration, regression, end-to-end, and user acceptance testing.
• Design, develop, and maintain automation frameworks using Selenium, Playwright, or equivalent technologies.
• Conduct REST API testing and automation using Postman or equivalent API testing tools.
• Perform SQL-based data validation and test data preparation activities.
• Evaluate AI-generated outputs for accuracy, consistency, grounding, hallucinations, and adherence to defined quality thresholds.
• Validate RAG-based retrieval systems, agent workflows, and tool-call orchestration.
• Execute negative-path, access-control, and sensitive-data exposure testing to ensure application security and reliability.
• Integrate automated test suites with Git/Bitbucket repositories and CI/CD pipelines.
• Validate AWS-hosted applications and analyze logs for issue identification and troubleshooting.
• Support User Acceptance Testing (UAT), maintain test evidence, and provide release-quality assessments.
• Collaborate with cross-functional teams to identify, track, and resolve product defects.
• Ensure adherence to quality standards, testing best practices, and release management processes.

Requirements

• Strong understanding of software testing methodologies, SDLC, and STLC.
• Experience in manual and automated testing of enterprise applications.
• Hands-on experience with API testing, UI automation, and database validation.
• Knowledge of AI/GenAI testing concepts, including RAG evaluation and AI response validation.
• Experience working in Agile/Scrum development environments.
• Familiarity with cloud-hosted applications, preferably on AWS.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication skills with the ability to articulate technical and business concepts clearly and concisely.

Required Skills

• Functional Testing
• Integration Testing
• Regression Testing
• End-to-End Testing
• Test Strategy and Test Case Design
• Requirements Traceability Management
• Defect Management using Jira
• Test Automation
• Selenium
• Playwright
• REST API Testing
• Postman
• SQL Data Validation
• AI Output Evaluation
• RAG Retrieval Evaluation
• Agent and Tool-Call Testing
• Git / Bitbucket
• CI/CD Integration
• AWS Application Testing
• UAT Support and Release Validation

Desired Skills

• Performance and Load Testing using JMeter, k6, or equivalent tools
• Prompt Injection Testing
• Model Safety and Adversarial Testing
• AWS Service Integration Testing
• Distributed Trace Analysis
• RPA Validation
• Document Extraction Testing
• Healthcare Domain Experience
• Contract Testing
• Test Data Automation
• Resilience Testing

Qualification

• BE / BTech / MCA or equivalent degree.
• Testing Certifications (ISTQB or equivalent) preferred.

Experience

4 to 7 Years

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.