Quality Analyst

Role & responsibilities

• Create detailed, comprehensive, and well-structured test plans, test cases, and testing strategies.
• Analyze business and technical requirements to design and execute effective test scenarios.
• Perform functional, regression, integration, system, API, and end-to-end testing.
• Develop and maintain automated test scripts using Playwright.
• Build, enhance, and maintain scalable automation frameworks to improve test coverage and execution efficiency.
• Leverage AI tools and AI agents to automate QA activities such as test case generation, regression testing, defect analysis, reporting, and workflow optimization.
• Identify opportunities to integrate AI-driven testing solutions into the QA lifecycle to improve productivity and reduce manual effort.
• Estimate testing effort and provide accurate timelines for testing activities.
• Identify, document, prioritize, and track defects using standard defect management tools.
• Collaborate closely with developers, product managers, and stakeholders to resolve issues and ensure product quality.
• Participate in sprint planning, requirement analysis, and release validation activities.
• Maintain testing standards, best practices, and documentation.
• Prepare daily status reports and update progress on company-approved project management and testing tools.
• Ensure timely delivery of testing activities while maintaining high-quality standards.
• Continuously research and adopt emerging QA methodologies, automation practices, and AI advancements.
• Work effectively with distributed teams and clients across different time zones.
• Demonstrate strong working knowledge of the Shopify ecosystem and eCommerce workflows.

Preferred candidate profile

• 35 years of experience in Software Quality Assurance.
• Minimum 2–3 years of hands-on experience testing Shopify-based applications.
• Strong hands-on experience in Automation Testing.
• Proficiency in Playwright using JavaScript/TypeScript.
• Experience designing, developing, and maintaining automation frameworks.
• Strong understanding of web application testing, API testing, cross-browser testing, and responsive testing.
• Hands-on experience using AI-powered testing tools and Large Language Models (LLMs) to improve QA productivity.
• Ability to design, build, and deploy AI Agents that automate QA workflows such as test generation, execution, bug analysis, reporting, and validation.
• Familiarity with AI frameworks and agent orchestration platforms (such as OpenAI APIs, LangChain, LangGraph, CrewAI, AutoGen, or similar) is highly preferred.
• Good understanding of CI/CD pipelines and automation integration.
• Experience with defect tracking and test management tools.
• Strong analytical and problem-solving skills with excellent attention to detail.
• Excellent verbal and written communication skills.
• Ability to work independently in a remote environment while managing multiple priorities.
• Passion for continuous learning and staying updated with emerging technologies in QA, automation, and AI.

Good to Have

• Experience with API automation tools.
• Experience working in Agile/Scrum environments.
• Knowledge of performance and security testing.
• Exposure to cloud testing platforms.
• Experience integrating automated tests into CI/CD pipelines.
• Familiarity with AI-assisted coding tools such as GitHub Copilot, Cursor, Windsurf, Claude, or ChatGPT.