Lead Product Manager - AI Evaluations

Lead Product Manager - AI Evaluations

Full-Time 54000 - 66000 £ / year (est.) Home office (partial)
C

At a Glance

  • Tasks: Lead product strategy for AI chat experiences and collaborate with cross-functional teams.
  • Company: Join Cleo, a fast-growing fintech startup revolutionising financial advice.
  • Benefits: Competitive salary, equity options, flexible work, and generous leave policies.
  • Other info: Inclusive culture with strong support for diverse backgrounds and career growth.
  • Why this job: Make a real impact on how people manage their finances with innovative AI solutions.
  • Qualifications: Extensive product management experience with LLMs and applied AI.

The predicted salary is between 54000 - 66000 £ per year.

About Cleo

At Cleo, we’re not just building another fintech app.

We’re on a mission to fundamentally change humanity’s relationship with money by putting a hyper‑intelligent financial advisor in everyone’s pocket.

About The Role

We are hiring an AI‑focused Product Manager to join our Chat pillar, building evaluation systems for our large‑language‑model chatbots.

As a Lead Product Manager you’ll work closely with engineers, designers, data scientists, analysts and writers on our core AI chatbot.

Key Responsibilities

  • Lead the product strategy for Cleo’s Chat experiences.
  • Collaborate closely with ML engineers, data scientists and analysts to launch new products with a global focus.
  • Define and track success metrics related to customer engagement, retention and financial well‑being.
  • Prioritise high‑impact opportunities and focus the squad on what matters most.
  • Translate complex data capabilities (e. g., LLMs and ML models) into intuitive user experiences.
  • Ensure the squad is aligned and involved in product direction and key decisions.
  • Continuously iterate on the product based on user insights, data and testing outcomes.
  • What We’re Looking For
  • Extensive product‑management experience building products that utilise LLMs and applied AI.
  • Experience working with evaluation frameworks.
  • Hands‑on experience building and launching products from scratch.
  • Experience with behaviour‑change products.
  • Strong prioritisation skills with the ability to focus a team on impactful work.
  • Collaborative and inclusive leadership style with a track record of empowering cross‑functional teams.
  • Ability to clearly communicate product decisions and trade‑offs to stakeholders.
  • Creativity in approaching product challenges and rethinking how people manage finances.
  • High energy and ownership mindset focused on driving measurable outcomes.
  • Passion for building tools that improve users’ financial lives through engaging, meaningful conversations.

What Do You Get for All Your Hard Work?

  • A competitive compensation package (base + equity) with bi‑annual reviews, aligned to quarterly OKR planning cycles.
  • The public progression framework and salary bandings can be viewed here:
  • https://cleo-ai. progressionapp. com/
  • Work at one of the fastest‑growing tech startups backed by top VC firms such as Balderton & EQT Ventures.
  • A clear progression plan – we want you to keep growing by leading others, challenging the status quo and owning your impact.
  • Flexibility to maintain a healthy work‑life balance.

Work where you work best – globally distributed team.

Hybrid options for London staff and optional travel for non‑London staff.

  • Other Benefits
  • Company‑wide performance reviews every 6 months.
  • Generous pay increases for high‑performing team members.
  • Equity top‑ups for team members when promoted.
  • 25 days annual leave plus public holidays, with an additional day for every year at Cleo (up to 30 days).
  • 6% employer‑matched pension (UK).
  • Private medical insurance via Vitality, dental cover and life assurance.
  • Enhanced parental leave.
  • 1‑month paid sabbatical after 4 years at Cleo.
  • Regular socials and activities, online and in‑person.
  • We’ll pay for your Open AI subscription.
  • Online mental health support via Spill.
  • Workplace nursery scheme.

• And many more!

Welcoming Everyone

We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neuro‑divergent people, parents, carers and people from lower socio‑economic backgrounds.

If there’s anything we can do to accommodate your specific situation, please let us know.

Download the Test Flight

App access for people in the UK & Europe: If you are an i OS user, please use this link to sign up for our Test Flight version of the app and explore the functionality and features:

  • https://testflight. apple. com/join/f DG9h Wng
  • #J-18808-Ljbffr

Lead Product Manager - AI Evaluations employer: Cleo

Cleo is an exceptional employer that fosters a collaborative and innovative work culture, where your contributions directly impact the development of cutting-edge AI solutions. With a strong emphasis on employee growth, you will have ample opportunities to mentor and lead talented teams while working in a dynamic environment that values creativity and forward-thinking. Located in a vibrant tech hub, Cleo offers unique advantages such as access to industry-leading resources and a supportive community that champions professional development.

C

Contact Details:

Cleo Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Lead Product Manager - AI Evaluations

Join Product Management Meetups

Get involved in local product management meetups or workshops. These events are perfect for meeting industry folks, sharing ideas, and staying updated on trends. Plus, you never know who might be hiring—it's a fantastic way to make connections that could lead to a job at places like Cleo!

Show Off Your Product Sense

Create case studies or mini-projects showcasing your product management skills, and share them on platforms like Medium or LinkedIn. This not only puts your skills on display but also boosts your visibility in the product community. Imagine how impressed the hiring team at Cleo would be by your initiative!

Utilise Online Communities

Dive into online product management communities like Product Coalition or Mind the Product. Engage in discussions, ask questions, and share your insights. These platforms are goldmines for networking and finding hidden job opportunities—many companies often scout talent from within these circles.

Leverage Your University Network

If you’ve recently graduated or are still in uni, tap into your alumni network for connections in product management. Many universities have their own job boards and affinity resources to help graduates land roles. Don't forget to keep an eye out for job openings at Cleo through your school's career services!

We think you need these skills to ace Lead Product Manager - AI Evaluations

Product Management
Large Language Models (LLMs)
Applied AI
Evaluation Frameworks
Behaviour Change Products
Prioritisation Skills
Collaborative Leadership

Some tips for your application 🫡

Show Off Your Product Passion:When applying for a product management role like Lead Product Manager - AI Evaluations, let your passion for developing products shine through in your cover letter. Share specific examples of products you've managed, how you solved user needs, and any successful outcomes you've achieved. This is your chance to showcase your understanding of the product lifecycle!

Highlight Your Cross-Functional Skills:Product management isn't just about understanding the product; it’s about collaborating with different teams! Make sure to emphasise your experience working with developers, designers, and marketers. Use your CV to showcase your ability to bridge gaps between these areas, and include relevant experiences that demonstrate your communication and leadership skills!

Include Your Metrics and Achievements:In a full-time product management application, data speaks volumes! Quantify your achievements wherever possible. Did you increase user retention by a certain percentage? Launch a product ahead of schedule? Include these metrics in your CV to paint a picture of your impact and effectiveness in previous roles.

Tailor Your CV to the Role:Make sure your CV is tailored for the Lead Product Manager - AI Evaluations position at Cleo. Use keywords from the job description and ensure your relevant experiences are front and centre. Highlight any certifications or relevant training you’ve completed that will make you stand out as a strong candidate for the role. And remember, we’re excited to see your application on our website!

How to prepare for a job interview at Cleo

Understand the Product Life Cycle

As a product management candidate, we need to get our head around the complete product life cycle. Be prepared to discuss real-world examples of how you’ve managed product development from ideation to launch. Bring specific insights on tools like JIRA or Trello that can help streamline these processes.

Showcase Your Cross-Functional Skills

Product management is all about collaboration. We should be ready to highlight how we’ve worked across teams—think marketing, engineering, and design. Prepare to discuss scenarios where you had to mediate differing opinions and how you got everyone on board with a shared vision.

Prepare for Case Studies

In a full-time role, we can expect to encounter case study questions during our interviews. Practise solving hypothetical product problems on the spot, such as prioritising features for a new app or improving user engagement metrics. This will show our analytical thinking and decision-making skills.

Know Your Metrics

Let’s face it, numbers are our best friends in product management. We should prepare to discuss key performance indicators (KPIs) and how we've used analytics to inform product decisions. Dive into examples where data has driven our strategy for improvements or justified product changes.