Test Automation Engineer

Role Overview

The Test Automation Engineer will build and maintain shared automated testing frameworks and suites covering UI, API, end-to-end (E2E), and regression testing. The role involves using AI tools to generate and improve tests, validating AI-generated code, integrating automation into CI/CD pipelines, and testing AI-powered features against reliable source data.

The ideal candidate has strong hands-on automation experience and at least 1 year of AI-assisted delivery experience.

Key Responsibilities

• Build and maintain reusable UI, API, E2E, and regression automation suites.
• Develop automation frameworks using Playwright, Selenium, TypeScript, or Python.
• Use AI tools to generate test scripts and assertions, then review and correct the output.
• Integrate automated tests into CI/CD pipelines using Azure DevOps or GitHub Actions.
• Manage test data, environment dependencies, and test execution.
• Investigate failures, flaky tests, incorrect locators, synchronization issues, and assertion problems.
• Test AI features by checking output accuracy, grounding, and consistency against source information.
• Maintain readable, reusable, reliable, and maintainable automation code.
• Track test coverage, regression execution time, failures, and automation effectiveness.
  
  

Mandatory Skills & Experience

• 5+ years of hands-on test automation experience.
• Strong experience building and maintaining automated test suites.
• Practical UI, API, E2E, and regression testing experience.
• Experience with Playwright or Selenium.
• Programming skills in TypeScript or Python.
• Experience with API testing tools such as Postman/Newman or equivalent.
• At least 1 year of hands-on AI-assisted delivery for test generation, automation development, or test maintenance.
• Ability to review AI-generated tests for correct locators, assertions, waits, reliability, and maintainability.
• Experience integrating automation into CI/CD pipelines.
• Ability to investigate test failures and distinguish genuine product defects from automation issues.
• Understanding that a passing automated test does not, by itself, prove product quality.
  
  

Preferred Skills

• Playwright with TypeScript.
• Azure DevOps pipelines or GitHub Actions.
• Codex, Augment Code, Claude, or GitHub Copilot.
• Experience testing GenAI or document-AI features.
• Validation of AI output against source documents or expected ground-truth results.
• Experience building shared automation frameworks adopted by multiple teams.
  
  

Skills: automation,e2e,artificial intelligence,typescript,playwright