Test Analyst - AI Assurance

Test Analyst  - AI Assurance

• Expert understanding of GenAI system architecture (RAG / Agents)
• Develop AI Assurance strategy to assess AI systems for quality, safety, reliability and responsible AI behavior
• Design & implement AI evaluation framework using Ragas, DeepEval,etc
• Expert level tool expertise on various market popular AI Evaluations tools & AI Observability platforms like Arize, Langfuse, Haize Labs, Galileo, Okareo, LangSmith, etc
• Integrate AI evaluation with CI/CD pipeline
• Team Management skills.
• Expert in Python.

Please apply only if you have the above experience.