At a Glance
- Tasks: Lead the evaluation of AI interactions and ensure quality across our data solutions.
- Company: Join LSEG, a global leader in financial markets and data innovation.
- Benefits: Enjoy competitive pay, flexible work options, and opportunities for growth.
- Other info: Be part of a culture that values integrity, partnership, and excellence.
- Why this job: Make a real impact on AI technology that drives financial stability.
- Qualifications: Experience in product management, QA automation, or ML evaluation frameworks required.
The predicted salary is between 36000 - 60000 £ per year.
As part of our AI@LSEG Product Management team, we are seeking a Senior Product Manager. This role will define how LSEG measures the accuracy, reliability and consistency of AI-powered interactions across our data, analytics and market solutions. You will establish the frameworks, processes and standards that evaluate LLM behaviour, MCP tool usage, and natural-language output quality across multiple AI stacks—ensuring our customers receive precise, trustworthy, and explainable results.
Key Responsibilities & Accountabilities
- Define requirements for internal tooling: scenario catalogues, result dashboards, model-versus-model comparisons, performance tracking and release gates.
- Contribute to group-wide AI governance by defining evaluation requirements that support responsible AI, explainability and bias mitigation.
Skills & Competencies
- Background in product management, QA/test automation, or ML evaluation frameworks with experience designing structured test systems at scale.
- Strong knowledge of LLMs, prompt engineering, and tool-augmented LLM workflows.
- Experience with test automation, scenario design, evaluation metrics and quality frameworks in complex systems.
- Familiarity with financial data, analytics workflows, or MCP-style interoperability.
- Ability to translate ambiguous real-world user tasks into formal evaluation structures and rubrics.
- Experience with LLM-based evaluators, rubric scoring systems, structured data validation, and regression frameworks.
- Familiarity with financial data pipelines, structured/unstructured data handling, analytics APIs, and Python/JS-based tooling ecosystems.
- Strong analytical skills: ability to identify quality gaps, failure patterns and reliability issues in AI systems.
- Ability to support product teams in shipping AI features with confidence.
Our purpose is the foundation on which our culture is built. Our values of Integrity, Partnership, Excellence and Change underpin our purpose and set the standard for everything we do, every day. They go to the heart of who we are and guide our decision making and everyday actions.
LSEG (London Stock Exchange Group) is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our culture of connecting, creating opportunity and delivering excellence shapes how we think, how we do things and how we help our people fulfil their potential.
Senior Product Manager, AI Evals in London employer: London Stock Exchange Group
At London Stock Exchange Group, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration. As a Lead Java Engineer in our Risk Platform team, you will have access to unparalleled growth opportunities, working alongside industry experts in a vibrant London setting that champions diversity and professional development. Join us to make a meaningful impact while enjoying competitive benefits and a supportive environment that values your contributions.
Contact Details:
London Stock Exchange Group Recruitment Team
StudySmarter Expert Advice🤫
We think this is how you could land Senior Product Manager, AI Evals in London
✨Join Product Management Meetups
Get involved in local product management meetups or workshops. These events are perfect for meeting industry folks, sharing ideas, and staying updated on trends. Plus, you never know who might be hiring—it's a fantastic way to make connections that could lead to a job at places like London Stock Exchange Group!
✨Show Off Your Product Sense
Create case studies or mini-projects showcasing your product management skills, and share them on platforms like Medium or LinkedIn. This not only puts your skills on display but also boosts your visibility in the product community. Imagine how impressed the hiring team at London Stock Exchange Group would be by your initiative!
✨Utilise Online Communities
Dive into online product management communities like Product Coalition or Mind the Product. Engage in discussions, ask questions, and share your insights. These platforms are goldmines for networking and finding hidden job opportunities—many companies often scout talent from within these circles.
✨Leverage Your University Network
If you’ve recently graduated or are still in uni, tap into your alumni network for connections in product management. Many universities have their own job boards and affinity resources to help graduates land roles. Don't forget to keep an eye out for job openings at London Stock Exchange Group through your school's career services!
We think you need these skills to ace Senior Product Manager, AI Evals in London
Some tips for your application 🫡
Show Off Your Product Passion:When applying for a product management role like Senior Product Manager, AI Evals, let your passion for developing products shine through in your cover letter. Share specific examples of products you've managed, how you solved user needs, and any successful outcomes you've achieved. This is your chance to showcase your understanding of the product lifecycle!
Highlight Your Cross-Functional Skills:Product management isn't just about understanding the product; it’s about collaborating with different teams! Make sure to emphasise your experience working with developers, designers, and marketers. Use your CV to showcase your ability to bridge gaps between these areas, and include relevant experiences that demonstrate your communication and leadership skills!
Include Your Metrics and Achievements:In a full-time product management application, data speaks volumes! Quantify your achievements wherever possible. Did you increase user retention by a certain percentage? Launch a product ahead of schedule? Include these metrics in your CV to paint a picture of your impact and effectiveness in previous roles.
Tailor Your CV to the Role:Make sure your CV is tailored for the Senior Product Manager, AI Evals position at London Stock Exchange Group. Use keywords from the job description and ensure your relevant experiences are front and centre. Highlight any certifications or relevant training you’ve completed that will make you stand out as a strong candidate for the role. And remember, we’re excited to see your application on our website!
How to prepare for a job interview at London Stock Exchange Group
✨Understand the Product Life Cycle
As a product management candidate, we need to get our head around the complete product life cycle. Be prepared to discuss real-world examples of how you’ve managed product development from ideation to launch. Bring specific insights on tools like JIRA or Trello that can help streamline these processes.
✨Showcase Your Cross-Functional Skills
Product management is all about collaboration. We should be ready to highlight how we’ve worked across teams—think marketing, engineering, and design. Prepare to discuss scenarios where you had to mediate differing opinions and how you got everyone on board with a shared vision.
✨Prepare for Case Studies
In a full-time role, we can expect to encounter case study questions during our interviews. Practise solving hypothetical product problems on the spot, such as prioritising features for a new app or improving user engagement metrics. This will show our analytical thinking and decision-making skills.
✨Know Your Metrics
Let’s face it, numbers are our best friends in product management. We should prepare to discuss key performance indicators (KPIs) and how we've used analytics to inform product decisions. Dive into examples where data has driven our strategy for improvements or justified product changes.