Analytics & Modeling Analyst

Job Summary

The Senior Analyst supports the validation, evaluation, and governance of advanced AI systems, including Machine Learning, Generative AI (GenAI), and Agentic AI models. This role ensures that the use of AI in Moody's Ratings is robust, reliable, and adheres to governance and regulatory standards under the direction of the VP-Data Science.

Responsibilities

• Execute hands-on validation and testing of AI and Machine Learning models, including GenAI and Agentic AI, following established evaluation frameworks.
• Develop and run systematic model evaluations to benchmark performance and safety, using industry leaderboards, SME review, and LLM-as-a-judge frameworks.
• Assess risks in AI systems, focusing on accuracy, bias, explainability, and operational integrity.
• Collaborate with technology, risk, compliance, and business stakeholders to support alignment with governance and regulatory standards.
• Maintain high standards of documentation, reporting, and continuous improvement in model risk management processes.
• Communicate validation results and recommendations to both technical and non-technical audiences.

Skills and Competencies

• 4+ years of experience in machine learning, with strong expertise in GenAI, Agentic AI, LLM evaluation frameworks, and associated risk considerations
• Hands on experience evaluating AI systems, including building or using tools and models to test performance, safety, and reliability of LLM based applications
• Experience with NLP, prompt engineering, RAG, agentic AI, and cloud deployment preferred (AWS or Azure etc)
• Proficiency in programming and analytics, with experience in Python, SQL, .NET, statistical analysis of model outputs, and advanced quantitative techniques
• Solid understanding of AI risk management and responsible AI practices, combined with experience in regulated or financial domains such as corporate finance, credit, or debt markets
• Excellent communication and documentation skills, enabling effective engagement with both technical and non technical stakeholders, including drafting requirements and user guides

Education

Master's or bachelor's degree in Computer Science, Mathematics, Financial Engineering, or a closely related quantitative field

About the team

The Digital Economy team at Moody's Ratings focuses on assessing and managing risks emerging from digital finance, artificial intelligence, and cyber threats, which are reshaping global financial systems and credit markets. The team provides thought leadership and analytical insights into how technologies like blockchain, AI, and digital assets impact operational resilience.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.