Staff Software Development Engineer in Test

The candidate will have responsibilities across the following functions:

Quality Strategy and Architecture:

• Define and own the testing pyramid across unit, integration, component, E2E, contract, and accuracy regression layers.
• Audit Abacus, Harmony.
• Set coverage and quality gates by repo/component risk tier and drive engineering alignment.
• Define testable-by-design patterns such as dependency injection, interface boundaries, and shift-left test requirements.

CI/CD Quality and Accuracy Gates:

• Own CI/CD quality gates, including static analysis, coverage enforcement, component/E2E checks, and accuracy regression checks.
• Partner with DL/engineering teams to make model accuracy regression a first-class release gate.
• Define fast vs full regression strategies and thresholds for PRs vs main branch releases.
• Ensure quality gates are visible, stable, and trusted by engineering teams.

Metrics, SLOs and Reliability:

• Build and own quality metrics: coverage, defect escape rate, accuracy per speciality, alert volume, code quality score, and reliability trends.
• Define SLOs for AQM accuracy, Abacus processing reliability, and Harmony latency with clear error budgets and alert thresholds.
• Lead defect retrospectives and ensure every escaped defect results in a test, monitor, or process improvement.
• Partner on canary accuracy monitoring, incident-response quality bar, and SRE-AI feedback loops.

Leadership and Mentorship:

• Mentor SDETs through structured reviews, code reviews, and development planning.
• Influence engineers across squads without relying on reporting authority.
• Champion quality is built in, not tested in across engineering.
• Partner with AI Agents Engineer to evaluate and improve the Testing Agent.

Requirements:

• 7+ years of SDET/QA engineering experience, including at least 2 years at Staff/Principal/Lead level or equivalent scope.
• Strong hands-on automation depth across at least two test frameworks, including pytest and/or Java-based frameworks such as JUnit/TestNG.
• Strong Java and Spring understanding; able to read application code, identify testability issues, and review test design meaningfully.
• Hands-on CI/CD quality pipeline ownership; has written CI YAML, configured required checks, and debugged pipeline/test infrastructure issues.
• Experience with static analysis and quality tools such as SonarQube, mypy, pylint, Checkstyle, SpotBugs, or equivalent.
• Experience with contract/component testing for distributed services.
• Experience with Docker and containerised test environments.
• Experience defining test strategy from scratch for inherited systems and driving remediation using data.
• Experience with ML/model regression or accuracy evaluation, or strong adjacent experience in data-heavy correctness testing.
• Strong SQL and BigQuery ability for defect analysis, trend rollups, accuracy/reliability correlation, and dashboard validation.
• Excellent leadership communication: can present quality health to engineering leadership with data and clear recommendations.

Nice to Have:

• Healthcare, medical coding, or other regulated/high-accuracy domain experience.
• Experience with Playwright/Selenium and large E2E suites.
• Experience with SLOs, error budgets, chaos/fault injection, or reliability testing.
• Experience integrating AI-assisted testing or code review workflows.
• Experience building or owning quality dashboards in Looker, Metabase, Grafana, or similar.