Test Analyst - AI Assurance

Strong understanding of GenAI system architecture (RAG / Agents) - Implement python-based AI Evaluation frameworks like Ragas, DeepEval, etc - Perform Model & Agent quality evaluation using tools like Arize, LangFuse, ConfidentAI, etc - Perform Responsible AI validation & report RAI metrics - Golden dataset curation & Synthetic dataset generation - Ability to instrument & establish AI Observability / Tracing using OTEL libraries Expert in Python

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.