GenAI Ops / LLMOps Engineer

GenAI Ops / LLMOps Engineer

Role Summary
Looking for a GenAI Ops / LLMOps Engineer with hands-on experience in monitoring, observability, and production operations of GenAI/ML solutions.

Key Responsibilities

• Implement AI/GenAI observability and monitoring for production solutions.
• Monitor concept drift, data drift, model quality, and performance.
• Monitor agentic AI solutions and workflows for reliability and failures.
• Monitor data pipelines supporting AI/ML applications.
• Manage model lifecycle, experiments, and tracking using MLflow.
• Support annotation, evaluation, and feedback workflows using Label Studio.
• Set up monitoring dashboards/alerts and troubleshoot production AI issues.

Must-Have Skills

• AI/ML/GenAI Observability & Monitoring
• Concept Drift / Data Drift Monitoring
• Agentic AI Solution Monitoring
• Data Pipeline Monitoring
• MLflow
• Label Studio
• MLOps / LLMOps
• Production troubleshooting

Good to Have

• GenAI / LLM applications
• RAG & Agentic AI architectures
• Python
• Model evaluation and feedback mechanisms
• Cloud AI/ML exposure