AI DevOps & Platform QA Engineer

AI DevOps & Platform QA Engineer

Experience : 5 to 9 Years

Location : Bangalore

Job Summary:

We are seeking an AI DevOps & Platform QA Engineer to ensure reliable, observable, and compliant deployments of AI/GenAI platforms and workflows. This role focuses on CI/CDintegrated test execution, cloud-based AI testing (Azure/AWS), and system/integration validation across AI pipelineswhile leveraging LLMs for intelligent test orchestration, guardrails enforcement, and automated security/compliance checks.

.

Key Responsibilities:

• Build and operate CI/CDintegrated test execution for AI/ML/GenAI workflows across environments
• Validate system, integration, and endtoend workflows for AI platforms (agents, APIs, RAG services, model endpoints, pipelines)
• Establish test reporting and observability (quality gates, run analytics, pipeline health, deployment risk visibility)
• Implement cloud-based AI testing strategies on Azure/AWS, including environment readiness and service integration checks
• Automate deployment validation including contract testing, dependency checks, and rollback verification
• Embed LLMs into CI/CD pipelines for:
• Intelligent test orchestration (prioritization, dynamic suite selection)
• Guardrails enforcement (policy checks, response constraints, safety rules)
• Automated compliance & security checks in AI deployments
• Partner with platform/SRE/engineering teams to improve reliability using SRE principles (SLIs/SLOs, error budgets, incident learnings)
• Support security & compliance awareness through scanning, policy enforcement, secrets management, and auditready reporting

Qualifications and Skills: 

• Bachelor’s or master’s degree in computer science, Engineering, Data Science, or equivalent experience.
• 6+ years of experience in QA automation or software engineering.
• 3+ years of experience working with AIdriven automation or intelligent testing frameworks.
• Minimum 2 years of handson experience in building or testing AIbased tools or platforms.

Must Have Tools

• Azure DevOps / GitHub Actions
• Cloud AI services (Azure/AWS)
• CI/CD test orchestration
• API & integration testing tools
• Observability dashboards
• AWS CloudWatch / Grafana / Prometheus
• Cursor AI / GitHub Copilot / Claude CLI