AI Engineer_100228

Company:A Large Global Organization

Key Skills: Prompt Engineering, LLM, Playwright Automation, Selenium, Retrieval-Augmented Generation (RAG), CICD, Api Testing

Roles and Responsibilities:

• Develop automated test suites using Selenium and Playwright for AI-enabled web flows and end-to-end scenarios.
• Design prompt engineering test cases to validate expected LLM behavior, including edge cases and regression coverage.
• Evaluate LLM outputs for quality and consistency using LLM evaluation approaches suitable for non-deterministic responses.
• Test RAG pipelines by validating retrieval behavior, context assembly, and final answer quality.
• Implement and maintain API testing coverage and integrate test execution into CI/CD pipelines.

Skills Required:

• 5 - 8 years of experience in software testing/automation with AI quality or LLM testing exposure.
• Selenium for automated UI testing and regression suites.
• Playwright Automation for reliable browser automation and test execution.
• Prompt Engineering and LLM evaluation/testing for non-deterministic AI behavior.
• Retrieval-Augmented Generation (RAG) testing to validate retrieval + generation quality. Good to Have:
• Api Testing for validating AI service endpoints and integrations.
• CI/CD pipeline experience for automated test runs and quality gates.

Education: Bachelor's degree in Computer Science, Engineering, or a related field.