Senior QA Engineer. - Pre Built AIC

About Leena AI

Leena AI is a leader in Agentic AI for the enterprise. We are building an iconic company, delivering AI Colleagues that transform back-office functions and accelerate the full promise of Generative AI - unlocking real productivity gains, cutting costs, and delighting employees at scale.

Leena AI provides the most forward-looking, open, and scalable Agentic AI architecture for the enterprise - it empowers CIOs and CTOs to develop, deploy, and manage AI Colleagues for the back office at scale. Built with full governance, compliance, security, and auditability at its core.

Leena AI integrates with 1000+ applications, including SAP, Salesforce, ServiceNow, Workday, and Microsoft Office 365. We are proud to be trusted by 500+ global enterprises and 20 million+ employees, including leading brands such as Nestl , Puma, Coca-Cola, Sony, and Etihad Airways.

Founded in 2018 and headquartered in New York, Leena AI has secured over $40M in financing from top-tier investors including Greycroft, Bessemer Venture Partners, B Capital, and Y Combinator.

Role Overview

As a Senior QA Engineer, you will be responsible for testing and validating Leena AI s Pre-built AI Colleagues, including Universal HR Assistant, Universal IT Assistant, and Universal Finance Assistant.

This is not a conventional QA role limited to UI and API testing. You will test AI-powered enterprise automation where the product must understand employee intent, retrieve the right knowledge, execute workflows, integrate with enterprise systems, respect access controls, and deliver reliable outcomes across multiple customer environments.

You will work closely with Product, Engineering, Solutions, Customer Success, and Implementation teams to ensure that our AI Colleagues are accurate, safe, reliable, enterprise-ready, and launch-ready.

What You ll Own:

• Own end-to-end QA for pre-built AI Colleague use cases across HR, IT, Finance, and other enterprise functions.

• Validate employee journeys, business workflows, and multi-step processes across standard and customer-specific configurations.

• Test enterprise integrations, APIs, authentication, data mapping, error handling, permissions, and workflow execution.

• Evaluate AI/LLM behavior, including intent understanding, knowledge retrieval, response accuracy, tool invocation, hallucinations, and task completion.

• Design test scenarios covering happy paths, edge cases, ambiguous queries, and failure scenarios.

• Build and maintain automated regression suites across UI, APIs, integrations, and backend workflows.

• Drive release readiness through CI/CD quality gates, production issue analysis, and regression testing.

• Validate enterprise readiness across security, tenant isolation, access controls, privacy, reliability, and performance.

• Partner with Engineering and Implementation teams to debug issues, improve testability, and support customer UAT.

What Were Looking For:
Must have

• 4-8 years of QA experience in enterprise SaaS, B2B software, workflow automation, ITSM, HRTech, FinTech, ERP, or CRM products.

• Strong experience testing complex enterprise workflows and third-party integrations.

• Hands-on API testing experience with Postman, REST Assured, Karate, or similar tools.

• Test automation experience with Playwright, Cypress, Selenium, or equivalent frameworks.

• Understanding of backend systems, APIs, databases, logs, webhooks, and asynchronous processing.

• Ability to debug issues using logs, API responses, database queries, and monitoring tools.

• Strong test design skills across functional, negative, edge-case, and role-based scenarios.

• Product mindset focused on customer outcomes, business logic, and end-to-end quality.

Good to Have

• Experience with HR, IT, Finance, or employee service automation products and enterprise platforms such as Workday, ServiceNow, SAP, Salesforce, or Microsoft 365.

• Experience testing AI/LLM products, copilots, RAG systems, or agentic workflows.

• Familiarity with LLM evaluation, hallucination testing, prompt variations, knowledge retrieval, and response quality assessment.

• Exposure to multi-tenant SaaS, RBAC, SSO, OAuth, SAML, audit logs, and compliance.

• Experience with performance testing, test data management, and basic SQL/NoSQL.