QE Automation Engineer GenAI/AI Testing

Engg. Skill

Automation

Job Title

Senior Quality Engineer L1 - 1 Position

Senior Quality Engineer L2 – 1 Position

Role

QE Automation Engineer

Work Model (Hybrid/WFO)

Hybrid

Experience Range (yrs.)

7+ years

Shift Timing

12pm- 9pm

JD: -Role summary: Hands-on Dev/Quality Engineer focused on testing GenAI applications/products, AI agents, chatbots, APIs and AI-enabled workflows.

Key skills / responsibilities:

Hands-on testing of GenAI/LLM applications, AI agents, conversational AI/chatbots and RAG-based solutions.

Validate response accuracy, relevance, grounding, hallucinations, consistency, guardrails and fallback/error scenarios.

Test prompts and responses across positive, negative, boundary and adversarial scenarios.

Perform functional, API, integration, end-to-end and regression testing.

API testing using Postman/Newman, REST Assured, pytest or equivalent.

UI/API automation using Playwright, Selenium, Cypress or equivalent.

Validate data and backend integrations using SQL and API/database validation.

Build and maintain automated regression suites integrated with CI/CD pipelines.

Azure/OpenAI GenAI application experience preferred.

Work flexibility: Ability to work in a globally distributed India-US model, provide regular working-hour overlap with the US team for collaboration, defect triage and testing, and support critical releases when required.