Lead QA Engineer - AI

Job Requirements

At Quest Global, it's not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better place—to make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster.

Key Responsibilities

Drive the quality of Agentic AI systems built to autonomously provision, monitor, and scale cloud infrastructure. You will design, develop, and maintain intelligent test suites to validate complex AI model behaviors, API reliability, and secure cloud orchestration workflows across platforms like AWS, Azure, or GCP.

• Typical experience should include:
• LLM validation against queries (this is not dependent on dev team). Simulate prompts and inform dev team which LLM is best
• MCP testing
• Connectivity testing
• Guardrail testing
• A2A testing
• Request Handler testing
• Orchestrator agent testing
• Build scalable, AI-driven test automation frameworks using Python or Java to validate LLM-based cloud orchestration decisions.
• Test agentic AI workflows that autonomously trigger, configure, or terminate cloud resources and monitor system responses.
• Collaborate with Data Engineers and Cloud Engineers to create synthetic datasets that reliably test AI model boundaries, edge cases, and drift.
• Integrate intelligent self-healing test suites into existing CI/CD pipelines (e.g., Jenkins, GitLab) to ensure zero-touch deployments.
• Perform rigorous validation of cloud security models, compliance, and RBAC implementations enforced by AI.
• Utilize AI-testing platforms to accelerate test generation and execution.
  
  

We are known for our extraordinary people who make the impossible possible every day. Questians are driven by hunger, humility, and aspiration. We believe that our company culture is the key to our ability to make a true difference in every industry we reach. Our teams regularly invest time and dedicated effort into internal culture work, ensuring that all voices are heard.

We wholeheartedly believe in the diversity of thought that comes with fostering a culture rooted in respect, where everyone belongs, is valued, and feels inspired to share their ideas. We know embracing our unique differences makes us better, and that solving the worlds hardest engineering problems requires diverse ideas, perspectives, and backgrounds. We shine the brightest when we tap into the many dimensions that thrive across over 21,000 difference-makers in our workplace.

Work Experience

• Experience: 6-9 years in software test automation, with at least 1 year specifically testing AI/ML applications or MLOps pipelines.
• Cloud Expertise: Strong working knowledge of AWS, Microsoft Azure, or Google Cloud Platform (GCP) operations and APIs.
• Programming: Advanced proficiency in Python, Java, or Go for building custom test scripts.
• AI/ML Knowledge: Familiarity with concepts like natural language processing, model evaluation metrics, and reinforcement learning.
• Tools: Hands-on experience with testing frameworks like PyTest, Selenium, or Playwright, along with API testing tools (Postman, REST Assured).
• Mindset: Strong problem-solving skills to tackle non-deterministic outcomes common in AI-automated environments.