AI Test Engineer

Role & responsibilities

• Design and validate AI enabled applications
• Data Validation for AI enabled applications
• Validate LLM outputs
• Test prompt versions and AI behaviour changes
• Automate functional and nonfunctional tests
• Test AI integrations, APIs, and workflows
• Perform regression testing for AI model/version changes
• Collaborate with developers on quality gates

Required Skills

• Application testing (manual + automation)
• Knowledge in Python
• CI/CD quality gates

AISpecific Skills

• Testing LLM outputs and prompt behavior
• Understanding of model variability and nondeterminism
• Test data management for AI
• Knowledge of responsible AI testing concepts