Artificial Intelligence Architect

Test Manager AI Architect / Manager

Location : Bangalore

Experience : 10 to 15 years

Job Summary:

The Test Manager – AI Architect / Manager is a senior leadership role responsible for defining, architecting, and driving the AIled Quality Engineering (QE) vision across the enterprise. This role owns AIdriven QA architecture, leads the design and deployment of AI bots, agents, and GenAI flows, and defines the endtoend AI strategy and roadmap for the ETMS practice.

The role requires a strong blend of handson AI architecture expertise, strategic leadership, and stakeholder communication, with the ability to productize intelligent automation and embed AIdriven quality governance across platforms.

Key Responsibilities:

• Architect and own AIdriven QA platforms across enterprise programs, ensuring scalability, observability, and governance
• Build, productize, and deploy AI Bots / AI Agents for testing, analytics, and quality decisioning
• Define and drive the endtoend AI strategy and roadmap for the ETMS practice
• Provide handson technical leadership in AI agents, GenAI architectures, and intelligent automation frameworks
• Design enterprisewide LLM integration strategies across:
• Test automation frameworks
• Internal QA tools
• Managed QA platforms
• enabling intelligent automation, AI observability, and quality governance
• Establish AIdriven quality metrics and evaluation frameworks using ML metrics (precision, recall, F1, confusion matrix)
• Lead evaluation, selection, onboarding, and governance of AI tools and platforms
• Integrate AI solutions into CI/CD pipelines for predictive quality, analytics, and automation
• Drive stakeholder communication and AI narrative building, translating complex AI capabilities into business value
• Define data strategy and governance models for AIenabled QA solutions
• Mentor and grow AI architects, test managers, and technical leaders within the practice

Qualifications and Skills: 

• Bachelor’s or master’s degree in computer science, Engineering, Data Science, or equivalent experience.
• 6+ years of experience in QA automation or software engineering.
• 3+ years of experience working with AIdriven automation or intelligent testing frameworks.
• Minimum 2 years of handson experience in building or testing AIbased tools or platforms.

Must Have Tools

• LangChain + LangSmith / LlamaIndex
• DeepEval / RAGAS
• MLflow / Comet ML
• Scikitlearn metrics
• Azure OpenAI / AWS Bedrock
• AutoGen