SDET

Responsibilities:

• Define and own the end-to-end test strategy for all initiatives, from feature-level acceptance criteria through system and regression testing.
• Establish quality gates, test coverage standards, and release readiness criteria across the engineering organization.
• Champion a shift-left testing culture by embedding quality practices early in the product development lifecycle.
• Design, build, and maintain scalable test automation frameworks for UI, API, and data layers.
• Develop automated regression and smoke test suites integrated into CI/CD pipelines such as GitHub Actions, Azure DevOps, or similar tools.
• Implement performance and load testing to validate system behavior at scale.
• Validate embedding models and vector search pipelines using semantic similarity, recall@k, precision metrics, and tools such as RAGAS, DeepEval, or custom harnesses.
• Build regression suites for LLM-powered features to detect prompt regressions, hallucination patterns, and output drift across model versions.
• Collaborate with AI/ML engineers to define ground-truth datasets, golden datasets, and human-in-the-loop evaluation workflows.
• Test multi-modal and agentic AI systems for correctness, safety, and performance.
• Partner with product managers, software engineers, and data scientists to review requirements and identify testable acceptance criteria early.
• Participate in sprint planning and retrospectives, representing quality and risk perspectives.
• Report test results, defect trends, and quality metrics to engineering leadership with actionable insights.

Requirements:

• 6+ years of individual contributor experience in software QA and test automation roles.
• Demonstrated track record of building and maintaining automation frameworks using Playwright, Selenium, Cypress, or pytest.
• Hands-on experience testing AI/ML systems, particularly RAG pipelines, LLM outputs, embeddings, or semantic search.
• Proficiency in Python and/or JavaScript/TypeScript for framework and tooling development.
• Experience integrating automated tests into CI/CD pipelines.
• Most recent experience at a technology or product-led company.
• Bachelor's or master's degree in computer science, software engineering, or a related field from a Tier 1 or Tier 2 institute.