BENGALURU · FULLTIME
QA Engineer
Ascendion
Bengaluru · onsite · Posted 27d ago
Sourced from
Undisclosed8–13 yrsfulltimeBengaluru
About a minute. You'll make an account on the way through.
agent · working
- Read this posting0.3s
- Found the form on Naukri · 14 questions to answer1.3s
- Decided the answers for all of them2.6s
- Tailor your résumé to this role
- Waiting for you
Section · 01
About this role
Staff AI Quality Engineer —
About the Role
As a Staff AI Quality Engineer -you will lead the technical test strategy and architectural validation for Lenovo’s cross-device agentic AI ecosystem. You will serve as the technical authority on evaluating non-deterministic systems, designing automated quality platforms that operate across personal computing form factors (PCs, tablets, and smartphones). You will drive non-functional quality standards—ensuring that privacy, security, accessibility, internationalization, and device thermals/battery efficiency are safeguarded—while acting as a crucial release partner alongside Product Management and PMO leads.
What Will You Do
- Test Automation Architecture: Architect scalable, distributed, cross-platform test automation infrastructure capable of executing synchronized, multi-device end-to-end tests across Windows and Android devices without reliance on UI flakiness.
- Agentic AI Quality Frameworks: Design automated evaluation methodologies to validate multi-step agent reasoning, tool-calling graphs, autonomous error recovery, and transactional rollback mechanisms; establish statistical release gates for non-deterministic model behaviors.
- Hardware & Runtime Resource Profiling: Formulate automated performance and endurance soak suites to benchmark on-device SLM execution against cloud fallback paths, monitoring thermal throttling, memory leaks, and battery draw across hardware device tiers.
- Non-Functional Quality Standards: Lead automated verification across non-functional pillars: red-teaming indirect prompt injection vulnerabilities, securing inter-process data barriers, standardizing automated accessibility (screen-reader verbosity, dynamic token streaming), and validating semantic fidelity across international locales.
- CI/CD Quality Pipelines & Gating: Drive the technical implementation of shift-left gating in continuous integration pipelines, establishing automated failure analytics, regression detection, and flakiness isolation frameworks.
- Cross-Functional Peer Leadership: Serve as a core technical gatekeeper alongside Product Management and PMO; establish release acceptance criteria, lead data-informed risk assessments during schedule compressions, and influence platform design for enhanced testability.
Basic Qualifications
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related technical field.
- 8+ years of progressive software quality engineering, test architecture, and automation experience covering multi-device hardware ecosystems (Windows and Android).
- 3+ years of experience leading quality strategy and automated evaluation frameworks for LLMs, agentic AI workflows, or conversational platforms.
- Advanced programming and architecture skills in Python, C++, C#, or Java, with a track record of building scalable test harnesses and mock environments for OS IPC, APIs, and background daemons.
- Proven experience architecting automated non-functional test frameworks: deep profiling of device performance (NPU/GPU/CPU, battery mA/h, memory), security red-teaming/prompt-injection defense, automated accessibility (WCAG), and i18n semantic evaluation.
- Deep technical expertise in CI/CD pipeline architecture, test orchestration, and statistical quality gating.
Preferred Qualifications
- Hands-on expertise implementing and tuning non-deterministic evaluation platforms (e.g., RAGAS, DeepEval, LangSmith, TruLens) in production pipelines.
- Direct experience testing local NPU runtimes and quantized models (INT4/INT8 vs. FP16) on client silicon (Qualcomm, Intel, AMD).
- Background designing automated testing for multimodal inputs (synchronized voice injection, screen-capture parsing, synthetic system events).
- Demonstrated ability to resolve complex release-gating disputes with Product Management and PMO using objective risk metrics and clear mitigation trade-offs.
Sourced from naukri
Section · 02
Skills
Quality Assurance EngineeringAutomationQualityorchestrationsoftware qualitycdframeworkEvaluationTest strategyProgrammingTest ArchitectureC plus plusquality standardsQuality EngineeringPythonAPIJavaproductionSoftware EngineeringCi/Cd
Section · Company
About Ascendion
Ascendion
IT Services & Consulting
3.3k+
employees
2022
4 years old
Basking Ridge, NJ
India
About
Ascendion is a leading provider of AI-first software engineering services. Our applied AI, software engineering, cloud, data, experience design, and talent transformation capabilities accelerate innovation for Global 2000 clients. Ascendion is headquartered in New Jersey. In addition to our remote/hybrid workforce, we have a presence in 12 countries and 40+ global offices across North America, Europe, and APAC. We are committed to building technology powered by Generative AI with an inclusive workforce, service to our communities, and a vibrant culture. For more information, please go to www.ascendion.com.
Industries
IT Services & Consulting
Employee ratings
799 reviews
3.2/ 5
Culture
3.2
Career growth
2.7
Work-life
3.3
Employees rate it well for
Salary80Work Life Balance52Work Culture47Senior Management40Appraisal33
Find them on