Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the evaluation of AI interactions and ensure quality across our data solutions.
- Company: Join LSEG, a global leader in financial markets and data innovation.
- Benefits: Enjoy competitive pay, flexible work options, and opportunities for growth.
- Why this job: Make a real impact on AI technology that drives financial stability.
- Qualifications: Experience in product management, QA automation, or ML evaluation frameworks required.
- Other info: Be part of a culture that values integrity, partnership, and excellence.
The predicted salary is between 36000 - 60000 £ per year.
As part of our AI@LSEG Product Management team, we are seeking a Senior Product Manager. This role will define how LSEG measures the accuracy, reliability and consistency of AI-powered interactions across our data, analytics and market solutions. You will establish the frameworks, processes and standards that evaluate LLM behaviour, MCP tool usage, and natural-language output quality across multiple AI stacks—ensuring our customers receive precise, trustworthy, and explainable results.
Key Responsibilities & Accountabilities- Define requirements for internal tooling: scenario catalogues, result dashboards, model-versus-model comparisons, performance tracking and release gates.
- Contribute to group-wide AI governance by defining evaluation requirements that support responsible AI, explainability and bias mitigation.
- Background in product management, QA/test automation, or ML evaluation frameworks with experience designing structured test systems at scale.
- Strong knowledge of LLMs, prompt engineering, and tool-augmented LLM workflows.
- Experience with test automation, scenario design, evaluation metrics and quality frameworks in complex systems.
- Familiarity with financial data, analytics workflows, or MCP-style interoperability.
- Ability to translate ambiguous real-world user tasks into formal evaluation structures and rubrics.
- Experience with LLM-based evaluators, rubric scoring systems, structured data validation, and regression frameworks.
- Familiarity with financial data pipelines, structured/unstructured data handling, analytics APIs, and Python/JS-based tooling ecosystems.
- Strong analytical skills: ability to identify quality gaps, failure patterns and reliability issues in AI systems.
- Ability to support product teams in shipping AI features with confidence.
Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence and Change underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions.
LSEG (London Stock Exchange Group) is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our culture of connecting, creating opportunity and delivering excellence shapes how we think, how we do things and how we help our people fulfil their potential.
Senior Product Manager, AI Evals in London employer: London Stock Exchange Group
Contact Detail:
London Stock Exchange Group Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Product Manager, AI Evals in London
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, especially those at LSEG. A friendly chat can open doors and give you insights that a job description just can't.
✨Tip Number 2
Prepare for interviews by diving deep into AI evaluation frameworks and product management principles. We want you to showcase your knowledge and passion, so practice articulating how your experience aligns with the role.
✨Tip Number 3
Don’t just wait for job postings—be proactive! Check our website regularly and apply directly. It shows initiative and gives you a better chance of standing out.
✨Tip Number 4
Follow up after interviews! A quick thank-you email can leave a lasting impression. Remind them why you're the perfect fit for the Senior Product Manager role and express your enthusiasm for the opportunity.
We think you need these skills to ace Senior Product Manager, AI Evals in London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV speaks directly to the role of Senior Product Manager, AI Evals. Highlight your experience with product management, QA/test automation, and ML evaluation frameworks. We want to see how your skills align with our needs!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about AI and how you can contribute to our mission at LSEG. Be sure to mention specific experiences that relate to the key responsibilities outlined in the job description.
Showcase Relevant Projects: If you've worked on projects involving LLMs, prompt engineering, or financial data analytics, make sure to include them in your application. We love seeing real-world examples of your work that demonstrate your analytical skills and ability to tackle complex systems.
Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you’re considered for the role. Plus, it’s super easy to do!
How to prepare for a job interview at London Stock Exchange Group
✨Know Your AI Inside Out
Make sure you brush up on your knowledge of LLMs and prompt engineering. Be ready to discuss how you've previously designed structured test systems and evaluated AI performance. This will show that you understand the technical aspects of the role and can contribute meaningfully.
✨Showcase Your Analytical Skills
Prepare examples that highlight your ability to identify quality gaps and reliability issues in AI systems. Use specific metrics or frameworks you've worked with to demonstrate your analytical prowess. This will help the interviewers see how you can support product teams effectively.
✨Understand Financial Data Workflows
Familiarise yourself with financial data, analytics workflows, and MCP-style interoperability. Being able to speak confidently about these topics will set you apart, as it shows you can translate complex user tasks into formal evaluation structures.
✨Embrace the Company Values
LSEG values Integrity, Partnership, Excellence, and Change. Think of examples from your past experiences that align with these values. Showing that you resonate with their culture will not only impress them but also demonstrate that you're a good fit for the team.
