Product Manager, Agent Harness & Modelling

Product Manager, Agent Harness & Modelling

Full-Time 80000 - 100000 £ / year (est.) No working from home possible
Cohere

At a Glance

  • Tasks: Lead the development of AI agents and ensure their reliability and performance.
  • Company: Join Cohere, a pioneering company in enterprise AI with a diverse and passionate team.
  • Benefits: Enjoy competitive pay, equity options, flexible work, and generous vacation time.
  • Other info: Collaborative culture with opportunities for personal growth and professional development.
  • Why this job: Make a real impact on AI adoption in major institutions while working with top experts.
  • Qualifications: 5+ years in product management with a focus on AI systems and strong technical skills.

The predicted salary is between 80000 - 100000 £ per year.

Who are we? Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products. Join us on our mission and shape the future!

About Cohere And North: Cohere is revolutionizing enterprise AI with North, an agentic AI platform designed to securely deploy AI agents and automations within organizations' infrastructure. North empowers employees to streamline workflows, automate repetitive tasks, and unlock actionable insights while ensuring data privacy and compliance. North combines cutting‑edge generative and search models with customizable integrations to drive productivity and innovation at scale.

Role Overview: We are seeking an Agent Harness Product Manager to own the execution layer that makes North agents reliable, capable, and production‑ready. This is a role that sits at the intersection of three domains:

  • Agent Loop and Execution: Own the core agent runtime: tool orchestration, parallel execution, sub‑agent delegation, sandbox code execution, and failure recovery. You will define how North agents plan and act across long, multi‑step workflows and ensure the execution environment is robust enough for the most demanding enterprise tasks. You are expected to engage at the implementation level, contributing to architecture decisions alongside engineering rather than simply handing off requirements.
  • Context Engineering: Own how our Agents manage the context window as a deliberately controlled resource. This includes progressive disclosure of tools and skills, context compaction and summarization, offloading of large payloads to a persistent filesystem, and the instrumentation that keeps agents oriented across extended trajectories.
  • Model‑Scaffolding Co‑evolution: Own the feedback loop between North’s harness and the Modeling Team. This PM is the connective tissue that makes that possible: ensuring harness design decisions are validated by Modeling before they are built, that evals are the shared bridge between both teams, and that as the harness evolves the model evolves with it.

Responsibilities:

  • Define and own the roadmap for North’s agent harness, including the agent loop, context engineering layer, tool orchestration, sandbox execution, and sub‑agent delegation.
  • Serve as the primary interface between North engineering and Cohere’s Modeling team, ensuring new harness capabilities are validated before being built and that neither team paints itself into a corner.
  • Own North’s agentic evaluation framework, ensuring evals are compatible with both the North harness and Modeling’s training infrastructure, and that they serve as a reliable bridge between product and research.
  • Engage enterprise customers to surface real‑world agentic failures and translate findings into concrete product and model requirements.
  • Stay current with the open‑source and commercial agent ecosystem and drive adoption decisions that keep North’s architecture aligned with emerging standards.

Requirements:

  • 5+ years of product management experience in agentic AI systems, developer infrastructure, or applied ML products.
  • Deep understanding of modern LLM agent architectures, including multi‑agent systems, tool‑augmented reasoning, memory and retrieval, programmatic orchestration, RAG, and long‑horizon execution.
  • Strong grasp of agentic evaluation design, including how to measure task completion, failure recovery, and long‑horizon reliability, and how to diagnose model vs. scaffolding gaps.
  • Technically deep enough to contribute to architecture decisions at the implementation level: comfortable reviewing and shaping design docs, reasoning about async execution patterns, sandboxed environments, filesystem design, and the tradeoffs that come with building harness capabilities into a production platform.
  • Ability to flex between ML research conversations and engineering architecture discussions with equal fluency.
  • Track record of shipping platform‑layer products with demonstrated impact on reliability, performance, or capability.

Nice‑to‑Haves:

  • An active practitioner of agent frameworks who regularly builds with and follows the latest developments in open‑source harnesses, coding agents, and orchestration tools in both professional and personal work.
  • Hands‑on experience with enterprise agentic deployments: multi‑tenant orchestration, tool permissioning, audit trails, and compliance requirements.
  • Familiarity with infrastructure constraints relevant to enterprise deployments: on‑premises environments, scalability challenges, and the operational tradeoffs of running complex agent workloads in restricted or air‑gapped settings.
  • Prior work at the intersection of research and product, translating nascent model capabilities into shipped product features.
  • Background working within or closely alongside an ML research or post‑training team.

Why Join Cohere?

  • Impact: Shape how Canada’s most important public institutions adopt and deploy frontier AI.
  • Innovation: Work alongside leading researchers and engineers solving complex ML challenges.
  • Growth: Competitive compensation, equity options, and opportunities for professional development.
  • Flexibility: Hybrid work model with offices in key global locations (Toronto, Montreal, New York, San Francisco, London, Paris, and Korea).

We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

Full‑Time Employees At Cohere Enjoy These Perks:

  • Open and inclusive culture and work environment.
  • Work closely with a team on the cutting edge of AI research.
  • Weekly lunch stipend, in‑office lunches & snacks.
  • Full health and dental benefits, including a separate budget to take care of your mental health.
  • 100% Parental Leave top‑up for up to 6 months.
  • Personal enrichment benefits towards arts and culture, fitness and well‑being, quality time, and workspace improvement.
  • Remote‑flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co‑working stipend.
  • 6 weeks of vacation (30 working days).

If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!

Product Manager, Agent Harness & Modelling employer: Cohere

Cohere is an exceptional employer that fosters a culture of innovation and collaboration, where employees are empowered to shape the future of AI. With competitive compensation, generous benefits including a 100% parental leave top-up, and a commitment to professional growth, Cohere offers a dynamic work environment in key global locations like Toronto and San Francisco. Join a diverse team of top-tier researchers and engineers dedicated to making a meaningful impact in the world of enterprise AI.

Cohere

Contact Details:

Cohere Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Product Manager, Agent Harness & Modelling

Tip Number 1

Network like a pro! Reach out to people in the industry, attend meetups, and connect with potential colleagues on LinkedIn. You never know who might have the inside scoop on job openings or can put in a good word for you.

Tip Number 2

Prepare for interviews by practising common questions and scenarios related to product management in AI. Think about how your experience aligns with the role and be ready to share specific examples of your past successes.

Tip Number 3

Showcase your passion for AI and product management during interviews. Share your thoughts on current trends, challenges, and innovations in the field. This will demonstrate your enthusiasm and commitment to the role.

Tip Number 4

Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our mission at Cohere.

We think you need these skills to ace Product Manager, Agent Harness & Modelling

Product Management
Agentic AI Systems
Developer Infrastructure
Applied ML Products
LLM Agent Architectures
Multi-Agent Systems
Tool-Augmented Reasoning

Some tips for your application 🫡

Show Your Passion for AI:When writing your application, let your enthusiasm for AI and its potential shine through. We want to see how you connect with our mission to scale intelligence and serve humanity. Share any personal projects or experiences that highlight your passion!

Tailor Your Experience:Make sure to customise your application to reflect the specific skills and experiences that align with the Product Manager role. Highlight your background in agentic AI systems and product management, and don’t forget to mention any relevant projects you've worked on.

Be Clear and Concise:We appreciate clarity! Keep your application straightforward and to the point. Use bullet points where necessary to make it easy for us to see your key achievements and qualifications. Remember, less is often more!

Apply Through Our Website:We encourage you to submit your application directly through our website. It’s the best way for us to receive your details and ensures you’re considered for the role. Plus, it shows you’re keen to join our team at Cohere!

How to prepare for a job interview at Cohere

Know Your Stuff

Make sure you have a solid understanding of agentic AI systems and the specific technologies mentioned in the job description. Brush up on modern LLM architectures, tool orchestration, and context engineering. Being able to discuss these topics confidently will show that you're not just familiar with the buzzwords but can actually contribute to the team.

Showcase Your Experience

Prepare to share specific examples from your past work that demonstrate your product management skills, especially in relation to AI systems. Highlight any projects where you’ve successfully shipped platform-layer products or worked closely with engineering teams. This will help the interviewers see how your experience aligns with their needs.

Engage with Real-World Scenarios

Think about potential real-world failures that North agents might encounter and how you would address them. Be ready to discuss how you would translate these challenges into actionable product requirements. This shows that you can think critically and are focused on delivering value to customers.

Be Ready for Technical Discussions

Since this role requires a deep technical understanding, be prepared to engage in discussions about architecture decisions and implementation details. Brush up on async execution patterns and sandboxed environments, as well as the trade-offs involved in building production-ready capabilities. This will demonstrate your ability to bridge the gap between product and engineering.