Newpage - Quality Assurance Engineer
NewPage Solutions · Chennai · onsite · Posted 72d ago
Not disclosed5–7 yrsfulltimeSourced from
About a minute. You'll make an account on the way through.
About this role
Job Description
We are hiring QA Engineers to validate that AI products do what they're meant to doand don't do what they shouldn't.
AI outputs aren't deterministic; testing them isn't either.
You will design golden-question suites, hunt hallucinations, verify evidence citations, and confirm guardrails hold under combinatorial pressure.
You will build coverage that survives an LLM swap, a prompt change, or a new retrieval index.
You sit close to the engineers building the systems you test, and you raise the quality bar by asking questions the model itself can't answer.
You treat AI as the substrate of the products you validate, and you stay current on how these systems break.
What You'll Do
Plan And Design :
At Newpage, were building a company that works smart and grows with agility, where driven individuals come together to do work that matters. We offer :
We are hiring QA Engineers to validate that AI products do what they're meant to doand don't do what they shouldn't.
AI outputs aren't deterministic; testing them isn't either.
You will design golden-question suites, hunt hallucinations, verify evidence citations, and confirm guardrails hold under combinatorial pressure.
You will build coverage that survives an LLM swap, a prompt change, or a new retrieval index.
You sit close to the engineers building the systems you test, and you raise the quality bar by asking questions the model itself can't answer.
You treat AI as the substrate of the products you validate, and you stay current on how these systems break.
What You'll Do
Plan And Design :
- Build test plans for AI products across large combinatorial matrices : input variants, user roles, content states, deployment surfaces.
- Maintain golden-question test suites that catch regressions when models, prompts, retrieval, or content change.
- Design coverage for the things AI products specifically get wrong : hallucinations, citation drift, prompt injection, context bleed, guardrail bypass, role escalation, stale or unapproved content surfacing where it shouldn't.
- Translate ambiguous quality requirements into concrete, repeatable test casesespecially where audit trails, access controls, and content provenance matter.
- Run structured test passes across web UIs and APIs; investigate failures deeply enough to give engineers a useful starting point, not just a screenshot.
- Validate evidence citations point to the right sources and that pending review or restricted content stays excluded from AI responses where the rules require it.
- Verify role-based access at the UI and API layersusers see what they should and nothing more.
- Verify data integrity using read-only SQL queries; cross-check what the UI shows against what the database holds.
- Exercise APIs directly via Postman, Insomnia, or curl; read OpenAPI specs and form requests without help.
- File defects that are clear, reproducible, and rankedstructured enough that an engineer can act without a meeting.
- Maintain regression coverage as products evolve : prompts change, retrieval indexes update, models get swapped, content gets added.
- Partner with engineers on evaluation rubrics, golden datasets, and acceptance criteria for AI behaviourthen verify the criteria actually hold in production.
- Stay current on AI/LLM evaluation tooling and apply what's useful : golden datasets, regression rubrics, hallucination scoring, structured eval frameworks.
- Maintain test documentation that survives team turnover : clear, structured, and findable.
- 5+ years manual and automation QA experience in product environments, production-grade.
- Hands-on experience testing AI / LLM-based products : output validation, hallucination detection, edge-case coverage, prompt injection awareness.
- Strong test-planning skills for large combinatorial test matrices.
- Hands-on with test management tooling : TestRail, Zephyr Scale, Xray, or equivalent.
- API testing fluency : Postman or Insomnia; comfortable reading OpenAPI/Swagger specs and exercising endpoints directly.
- Browser-based debugging skills : Chrome DevTools (Network, Console, Application), cross-browser verification.
- Bug tracking and workflow tooling : Jira, Linear, or equivalent.
- SQL basics : read-only queries to verify data state in PostgreSQL or equivalent.
- Documentation discipline : clear, structured test plans and defect reports in Confluence, Notion, or equivalent.
- Comfort with enterprise content workflows, audit-trail verification, and role-based access checks.
- A clear-eyed view of where current AI tooling helps and where it falls short.
- Curiosity, persistence, and a willingness to dig past the surface symptom into the underlying cause.
- Understanding of MLOps, model serving, scaling and monitoring workflows (e.g., BentoML, MLflow, Vertex AI, AWS Sagemaker)
- Exposure to evaluation tools (Ragas, Promptfoo, DeepEval, LangSmith)read-only or interpretive use is fine.
- Automation experience with Playwright, Cypress, or equivalenteven if the role is primarily manual.
- Browser Stack or similar cross-browser/device platforms.
- GDPR-style data handling verification experience.
- Pharma, healthcare, or other regulated-industry exposure.
- Familiarity with EU AI Act or similar AI governance and compliance frameworks.
At Newpage, were building a company that works smart and grows with agility, where driven individuals come together to do work that matters. We offer :
- A people-first culture - Supportive peers, open communication and a strong sense of belonging
- Smart, purposeful collaboration - Work with talented colleagues to create technologies that solve meaningful business challenges
- Balance that lasts - We respect your time and support a healthy integration of work and life
- Room to grow - Opportunities for learning, leadership and career development, shaped around you
- Meaningful rewards - Competitive compensation that recognises both contribution and potential
Sourced from foundit
Skills
testing AI LLM-based productsNotionPostman ToolOpen ApiConfluencetestrailLinearchrome devtoolsinsomniaAutomation QAJira AtlassianZephyr Scaleoutput validationX-Rayhallucination detectionSQLSwaggerAPI Testing
About NewPage Solutions
NewPage Solutions
None
CO
₹21.9L PA avg
Avg at NewPage Solutions
About
Digital Health Solutions Provider Newpage Solutions is a Digital & Connected Health Solutions provider working with leading healthcare, pharmaceutical, and life science organizations. We help our clients leverage emerging technologies such as Artificial Intelligence, Machine Learning, IoT, and mobile, etc., to solve their most complex problems at high speed. Our team is familiar with the unique challenges of the healthcare industry and has built a strong expertise in addressing them using technology. From strategy, custom software development to testing and deployment, we are ready to help you at every stage of your digital transformation journey. Our team works on diverse array of technologies including: Adobe, Drupal, Salesforce.com, Hubspot, Marketo, Medallia, Veeva, Adobe Analytics, Medallia DXA,Marketo, Tableau, Ionic Hybrid, iOS Native, Android Native, React, Angular, Vue.js, Big Data, ML AI model development, Data Platforms ETL, Data Warehousing, Enterprise Data Model, etc. - Experience delivering 100+ projects - Projects deployed across 27+ countries - Solutions in patient engagement, remote patient monitoring, virtual research, and augmented intelligence - Accel, our proprietary cloud-based, backend platform reduces app development time by 70 to 80% - Recognized by CIO Review as one of the “50 most promising healthcare solution providers” in the world - Recognized as a "Great place to work" two years in a row 2023 and 2024.
Industries
Health CareInformation TechnologyLife SciencePharmaceuticalSoftware
Employee ratings
1 reviews
5.0/ 5
Culture
5.0
Career growth
4.0
Work-life
4.0
Employees rate it well for
Company Culture50Overall Company50
Find them on