AI & Model Evaluation Product Director - London Stock Exchange Group

LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a commitment to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge, and worldwide presence across financial markets, we enable businesses and economies around the world to fund innovation, manage risk and create jobs.

Our People: People are at the heart of what we do and drive the success of our business. Our culture of connecting, creating opportunity and delivering excellence shape how we think, how we do things and how we help our people fulfil their potential. We embrace diversity and actively seek to attract individuals with unique backgrounds and perspectives. We break down barriers and encourage teamwork, enabling innovation and rapid development of solutions that make a difference.

Role Purpose: We are seeking an experienced AI & Model Evaluation Manager to lead the evaluation, validation, and governance of advanced AI, machine learning, and statistical models across our Active Data Layer programme of development. This role blends technical depth, strategic leadership, and strong stakeholder management, ensuring that our models are accurate, reliable, safe, and aligned with regulatory and organisational standards.

Key Responsibilities:

• AI & ML Model Evaluation: Lead the design and execution of evaluation methodologies for LLMs, multimodal systems, AI agents, and traditional ML models.
• Model Validation & Governance: Direct the independent review and validation of models across teams, ensuring compliance with internal LSEG governance standards and processes, and relevant regulatory expectations.
• Experimentation & Monitoring: Oversee the development and operation of online and offline experimentation platforms, including A/B testing, shadow deployments, canary releases, and continuous monitoring.
• Leadership & Strategy: Work collaboratively within a cross-functional high-performing team, fostering innovation, technical excellence, and a collaborative culture.
• Stakeholder Engagement: Act as a trusted advisor to model owners, developers, and business leaders, translating complex technical findings into actionable insights.

Required Experience & Qualifications:

• Bachelor's, Master's, or PhD or equivalent experience in Computer Science, Machine Learning, Applied Mathematics, Statistics, Financial Engineering, or a related quantitative field.
• Significant professional experience (typically 7-12+ years) in AI/ML product development / management, model validation, quantitative research, risk modelling, or related areas.
• Demonstrated success working with technical teams or senior specialists in high-stakes modelling environments.
• Deep understanding of AI/ML systems, including LLMs, agentic architectures, RAG pipelines, credit or pricing models, or risk modelling techniques.
• Excellent communication skills, with the ability to present complex findings clearly to both technical and non-technical audiences.

What Success Looks Like: Models across the organisation consistently meet high standards of quality, safety, performance, and compliance. The business benefits from reliable model-driven decisions, underpinned by transparent, well-governed evaluation practices.