Qa Engineer

Position Summary

We are seeking an experienced Senior Quality Assurance Engineer to ensure the quality, reliability, security, and performance of a cloud-native enterprise software product running on Microsoft Azure.

This role is responsible for defining and implementing quality engineering strategies, designing automated testing frameworks, developing comprehensive test suites, and driving continuous quality improvements across the software development lifecycle. The ideal candidate is a hands-on test automation expert who partners closely with Product Managers, Business Analysts, Developers, DevOps Engineers, and Architects to ensure software is delivered with the highest levels of quality and operational excellence.

In addition to traditional quality assurance responsibilities, the successful candidate will possess working knowledge of Artificial Intelligence (AI) technologies and AI-enabled software solutions, including testing approaches for AI-powered applications, intelligent agents, and generative AI capabilities.

Key Responsibilities

Quality Engineering Leadership

• Serve as a senior member of the engineering organization responsible for establishing and promoting quality engineering best practices.
• Define quality standards, testing strategies, and automation frameworks across product teams.
• Drive shift-left testing practices throughout the software development lifecycle.
• Participate in architecture, design, and requirements reviews to identify quality risks early.
• Mentor QA engineers and developers on testing and quality engineering practices.
• Advocate for continuous improvement and quality-first development culture.

Test Automation

• Design, develop, and maintain robust automated test frameworks and test suites.
• Implement automated testing across:
• Functional Testing
• API Testing
• UI Testing
• Integration Testing
• Regression Testing
• Performance Testing
• Security Testing
• Integrate automated testing into CI/CD pipelines.
• Improve automation coverage and reduce manual testing effort.
• Analyze test failures and drive root-cause resolution.

Enterprise Application Testing

• Validate complex business workflows and enterprise application functionality.
• Develop comprehensive test plans, test cases, and test scenarios.
• Ensure requirements are testable and traceable throughout the development lifecycle.
• Perform exploratory, system, integration, and end-to-end testing.
• Verify software meets functional and non-functional requirements.

Cloud-Native Quality Assurance

• Test cloud-native applications running within Microsoft Azure.
• Validate reliability, scalability, resiliency, and fault-tolerance requirements.
• Verify integrations across distributed systems, APIs, messaging platforms, and databases.
• Ensure applications meet enterprise security, compliance, and operational standards.
• Participate in release validation and production-readiness assessments.

AI & Intelligent Application Testing

• Support testing of AI-powered product capabilities.
• Validate outputs from Generative AI and Large Language Model (LLM) integrations.
• Develop test strategies for:
• AI Chatbots
• AI Assistants
• AI Agents
• Retrieval-Augmented Generation (RAG) Solutions
• Intelligent Search Experiences
• Evaluate AI output quality, consistency, accuracy, and reliability.
• Support Responsible AI practices including fairness, transparency, and governance.
• Partner with AI engineers to establish AI evaluation methodologies and testing frameworks.

DevOps & Continuous Testing

• Integrate quality gates into CI/CD pipelines.
• Develop automated validation processes for software releases.
• Support infrastructure validation and deployment testing.
• Monitor quality metrics and test coverage.
• Contribute to DevSecOps and continuous delivery initiatives.

Required Qualifications

Education

• Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field.
• Equivalent professional experience will be considered.

Experience

• 7+ years of software quality assurance experience.
• 5+ years of hands-on automated testing experience.
• Experience supporting enterprise-scale software products.
• Experience working within Agile and Scrum delivery environments.
• Experience collaborating directly with development teams throughout the SDLC.

Required Technical Skills

Test Automation

Expertise in one or more of:

• Playwright
• Selenium
• Cypress
• Puppeteer

Experience with:

• Test automation architecture
• Automated regression testing
• CI/CD-based test execution
• Automated reporting and dashboards

API Testing

Experience with:

• REST APIs
• Postman
• Swagger/OpenAPI
• Automated API validation
• Contract testing
• Integration testing

Programming & Scripting

Hands-on experience with:

• C#
• .NET
• Python
• JavaScript / TypeScript
• PowerShell

Ability to develop maintainable automation frameworks and supporting utilities.

Performance & Security Testing

Experience with:

• Load testing tools
• Performance test design
• API performance validation
• Security testing fundamentals
• Vulnerability assessment processes

Microsoft Azure Experience

Working knowledge of:

• Azure App Services
• Azure Functions
• Azure Kubernetes Service (AKS)
• Azure SQL Database
• Azure Cosmos DB
• Azure Storage
• Azure API Management
• Azure DevOps
• Azure Monitor
• Application Insights
• Azure Entra ID

Ability to test applications operating in cloud-native Azure environments.

DevOps & CI/CD Experience

Experience with:

• Azure DevOps Pipelines
• GitHub Actions
• Automated build and deployment pipelines
• Test execution within CI/CD workflows
• Quality gates and release validation processes

AI Knowledge

Working knowledge of:

• Generative AI concepts
• Large Language Models (LLMs)
• Prompt engineering fundamentals
• AI-assisted software development
• AI quality evaluation techniques
• AI Agents and agentic workflows
• Retrieval-Augmented Generation (RAG)
• Azure OpenAI Service
• Azure AI Search
• Responsible AI principles

Understanding of the unique testing challenges associated with AI-generated outputs, probabilistic systems, hallucinations, grounding, and AI governance.

Preferred Qualifications

• ISTQB Advanced Certification
• Certified Software Test Engineer (CSTE)
• Azure Fundamentals (AZ-900)
• Azure Developer Associate (AZ-204)
• Experience testing AI-enabled business applications.
• Experience testing distributed microservices architectures.
• Experience with containerized applications and Kubernetes.
• Experience implementing quality engineering practices in cloud-native environments.

Leadership Competencies

• Quality-first mindset
• Strong analytical and problem-solving skills
• Technical leadership and mentoring
• Attention to detail
• Risk assessment and mitigation
• Continuous improvement orientation
• Collaboration and teamwork
• Strong written and verbal communication
• Customer-focused thinking

Success Measures

• Increased automated test coverage
• Reduced production defects and escaped issues
• Improved release quality and deployment confidence
• Faster testing cycles and feedback loops
• Increased reliability and performance of Azure-hosted applications
• Successful validation of AI-powered capabilities
• Strong collaboration across engineering, product, and operations teams
• Continuous improvement of overall software quality metrics

Ideal Candidate Profile

The ideal Senior Quality Assurance Engineer combines strong software engineering and test automation expertise with a passion for delivering exceptional product quality. They are comfortable testing complex Azure-based enterprise applications, building scalable automation frameworks, and helping teams confidently adopt AI-powered capabilities while maintaining rigorous standards for reliability, security, performance, and user experience.