Test Engineer

About Position:

We are seeking an AI Test Engineer with 8-14 years of experience in Software Testing, Test Automation, and AI/Generative AI validation. The ideal candidate will be responsible for ensuring the quality, reliability, safety, and correctness of AI-powered applications across the software development lifecycle. This role requires expertise in testing Large Language Models (LLMs), Agentic AI solutions, prompt engineering workflows, AI integrations, and automated testing frameworks.

• Role: Test Engineer
• Location: Bangalore
• Experience: 8 to 14 years
• Job Type: Full Time Employment

What You'll Do:

• Design and execute comprehensive test strategies for Generative AI and Agentic AI applications.
• Validate LLM outputs for accuracy, bias, hallucinations, safety, and consistency.
• Test prompt versions and evaluate AI behavior changes across model updates.
• Develop and maintain automated test frameworks for AI-enabled applications.
• Execute functional, regression, integration, performance, and non-functional testing.
• Test AI integrations, APIs, workflows, and external service connections.
• Perform regression testing for AI model updates, prompt changes, and version upgrades.
• Collaborate with developers, AI engineers, and product teams to establish quality gates.
• Create and manage test datasets for AI validation and benchmarking.
• Monitor AI application performance and identify risks related to model drift and output quality.
• Support CI/CD quality gates and automated validation pipeline

Expertise You'll Bring:

• Strong experience in Manual and Automation Testing.
• Hands-on experience with AI/Generative AI testing.
• Strong understanding of Large Language Models (LLMs) and AI application behavior.
• Experience validating AI outputs for accuracy, safety, bias, and hallucinations.
• Knowledge of Agentic AI systems and workflow testing.
• Experience with Selenium and Playwright automation frameworks.
• Strong API testing experience using tools such as Postman, REST Assured, or equivalent.
• Understanding of model variability, non-deterministic outputs, and AI evaluation methods.
• Experience with AI prompt testing and prompt optimization validation.
• Strong knowledge of test data management practices for AI systems.
• Familiarity with Responsible AI principles and AI risk assessment.
• Experience integrating testing into CI/CD pipelines.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder collaboration capabilities.
• Experience working in Agile/Scrum environments.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."