Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the evaluation of AI interactions and ensure quality across our data solutions.
- Company: Join LSEG, a global leader in financial markets and data innovation.
- Benefits: Enjoy competitive pay, flexible work options, and opportunities for growth.
- Why this job: Make a real impact on AI technology that drives financial stability.
- Qualifications: Experience in product management, QA automation, or ML evaluation frameworks required.
- Other info: Be part of a culture that values integrity, partnership, and excellence.
The predicted salary is between 42000 - 60000 £ per year.
As part of our AI@LSEG Product Management team, we are seeking a Senior Product Manager. This role will define how LSEG measures the accuracy, reliability and consistency of AI-powered interactions across our data, analytics and market solutions. You will establish the frameworks, processes and standards that evaluate LLM behaviour, MCP tool usage, and natural-language output quality across multiple AI stacks—ensuring our customers receive precise, trustworthy, and explainable results.
Key Responsibilities & Accountabilities- Define requirements for internal tooling: scenario catalogues, result dashboards, model-versus-model comparisons, performance tracking and release gates.
- Contribute to group-wide AI governance by defining evaluation requirements that support responsible AI, explainability and bias mitigation.
- Background in product management, QA/test automation, or ML evaluation frameworks with experience designing structured test systems at scale.
- Strong knowledge of LLMs, prompt engineering, and tool-augmented LLM workflows.
- Experience with test automation, scenario design, evaluation metrics and quality frameworks in complex systems.
- Familiarity with financial data, analytics workflows, or MCP-style interoperability.
- Ability to translate ambiguous real-world user tasks into formal evaluation structures and rubrics.
- Experience with LLM-based evaluators, rubric scoring systems, structured data validation, and regression frameworks.
- Familiarity with financial data pipelines, structured/unstructured data handling, analytics APIs, and Python/JS-based tooling ecosystems.
- Strong analytical skills: ability to identify quality gaps, failure patterns and reliability issues in AI systems.
- Ability to support product teams in shipping AI features with confidence.
Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence and Change underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions.
LSEG (London Stock Exchange Group) is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our culture of connecting, creating opportunity and delivering excellence shapes how we think, how we do things and how we help our people fulfil their potential.
Senior Product Manager, AI Evals employer: London Stock Exchange Group
Contact Detail:
London Stock Exchange Group Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Product Manager, AI Evals
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, especially those at LSEG. A friendly chat can open doors and give you insights that a job description just can't.
✨Tip Number 2
Prepare for interviews by diving deep into AI evaluation frameworks and product management principles. We want you to showcase your knowledge and passion, so practice articulating your thoughts clearly.
✨Tip Number 3
Showcase your experience with real-world examples. When discussing your background, highlight specific projects where you’ve tackled challenges similar to those at LSEG. This will make you stand out!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our team.
We think you need these skills to ace Senior Product Manager, AI Evals
Some tips for your application 🫡
Tailor Your CV: Make sure your CV speaks directly to the role of Senior Product Manager, AI Evals. Highlight your experience with product management, QA/test automation, and ML evaluation frameworks. We want to see how your skills align with our needs!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about AI and how your background in structured test systems can help us at LSEG. Let’s see your personality come through while keeping it professional.
Showcase Relevant Projects: If you've worked on projects involving LLMs, prompt engineering, or financial data analytics, make sure to mention them. We love seeing real-world examples of your work that demonstrate your analytical skills and ability to tackle complex systems.
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team at StudySmarter!
How to prepare for a job interview at London Stock Exchange Group
✨Know Your AI Inside Out
Make sure you brush up on your knowledge of LLMs and prompt engineering. Be ready to discuss how you've previously designed structured test systems and evaluated AI performance. This will show that you understand the technical aspects of the role and can contribute meaningfully.
✨Showcase Your Analytical Skills
Prepare examples that highlight your ability to identify quality gaps and reliability issues in AI systems. Discuss specific scenarios where you've translated ambiguous user tasks into formal evaluation structures. This will demonstrate your analytical prowess and problem-solving skills.
✨Familiarise Yourself with Financial Data
Since the role involves financial data and analytics workflows, it’s crucial to have a solid understanding of these areas. Brush up on relevant concepts and be prepared to discuss how your experience aligns with the financial sector's needs.
✨Emphasise Your Collaborative Spirit
LSEG values partnership and collaboration, so be ready to share experiences where you've worked effectively within a team. Highlight how you’ve supported product teams in shipping AI features confidently, showcasing your ability to work towards common goals.
