At a Glance
- Tasks: Lead the strategy and roadmap for our LLM inference product, driving customer success.
- Company: Join a remote-first tech collective focused on innovation and collaboration.
- Benefits: Enjoy flexible hours, generous paid time off, and meaningful stock options.
- Other info: Fast-paced release cycles followed by downtime; twice-yearly company retreats.
- Why this job: Make a real impact in AI while working with cutting-edge technology and talented teams.
- Qualifications: Proven experience in product management within technical environments and strong understanding of LLM inference.
The predicted salary is between 72000 - 88000 £ per year.
We're looking for a Senior Product Manager — LLM Inference to own the strategy, roadmap, and commercial success of Runware's LLM inference offering, spanning our on-demand Model API and dedicated inference solutions. This is a hands‑on senior individual contributor role with end‑to‑end ownership of the customer‑facing LLM product — from initial model discovery and API integration to production adoption, scaling, and enterprise expansion.
You'll work at the intersection of developer experience, LLM capabilities, inference performance, and unit economics, identifying where Runware can deliver the most value and translating customer needs into a focused, commercially sustainable product roadmap. You'll partner closely with Engineering, Design, Security, and go‑to‑market teams, as well as our Serverless & Compute Product Manager, who owns the underlying compute platform. Together, you'll align on shared infrastructure priorities and capacity requirements while driving the success of the LLM offering.
What you’ll do:
- Own the LLM inference product strategy and roadmap. Define priorities across model availability, API capabilities, production readiness, and customer adoption, balancing developer needs, technical feasibility, business impact, and unit economics.
- Drive customer discovery and product‑market fit. Work directly with developers, AI teams, and technical decision‑makers to understand production workloads, evaluate competing solutions, identify adoption barriers, and translate market insights into product decisions.
- Own the model catalog and lifecycle. Guide model discovery, evaluation, launches, and deprecations across open‑weight, proprietary, and custom or fine‑tuned models. Partner with Engineering and Partnerships on model selection, serving, and routing decisions.
- Shape the developer experience and API capabilities. Make it easy for customers to evaluate, integrate, migrate, and scale LLM workloads through API compatibility, SDKs, documentation, and capabilities such as streaming, tool calling, structured outputs, caching, and batch inference. Support compatibility with OpenAI Chat Completions and Anthropic Messages formats.
- Define production inference requirements. Partner with Engineering on performance, reliability, and cost trade‑offs, including latency, time to first token, throughput, concurrency, availability, and serving efficiency. Translate customer workloads into requirements for dedicated capacity, rate limits, routing, fallbacks, and observability.
- Drive adoption and commercial growth. Partner with Sales, Marketing, and Partnerships on product positioning, pricing, packaging, and technical evaluations. Support customer progression from self‑service usage to sustained production workloads and dedicated inference commitments.
- Translate enterprise needs into scalable product capabilities. Work with Engineering and Security to define requirements for data residency, retention controls, service commitments, and other production‑critical capabilities.
- Stay hands‑on throughout product delivery. Write clear requirements, prototype solutions, test APIs, reproduce customer issues, and work closely with engineers to resolve technical constraints and deliver high‑quality releases.
- Own product performance and business outcomes. Track activation, production usage, retention, expansion, revenue, gross margin, and service quality. Use customer feedback and product data to continuously refine priorities and measure impact.
Proven product ownership in a technical, developer‑facing environment:
- Experience leading API products, developer platforms, AI infrastructure, or similar technically complex offerings from strategy and development through launch, adoption, and commercial growth.
- Strong understanding of production LLM inference. Ability to evaluate model capabilities and serving trade‑offs, including output quality, context length, token consumption, latency, throughput, reliability, and cost, and translate them into practical product decisions.
- Deep understanding of developer experience and API products. Familiarity with developer workflows from initial integration to production scale, including API design, compatibility, migration, SDKs, documentation, and differences in model capabilities.
- Strong commercial and product judgment. Ability to balance customer requirements, technical constraints, market opportunities, pricing considerations, and unit economics when setting product priorities.
- Experience working directly with technical customers. Proven ability to lead customer discovery, engage with developers and technical decision‑makers, assess production use cases, and distinguish recurring market needs from isolated requests.
- Hands‑on technical aptitude. Comfortable testing APIs, exploring product behavior, analyzing usage data, building prototypes, and discussing implementation trade‑offs with engineers.
- Strong execution and cross‑functional leadership. Ability to navigate ambiguity, communicate decisions clearly, align stakeholders, and take accountability for outcomes from initial discovery through delivery and measurable results.
Strong Differentiators:
- Direct experience building or scaling an LLM inference API, model‑serving platform, or AI infrastructure product.
- Knowledge of GPU inference and model‑serving technologies, including batching, quantization, KV caching, capacity planning, and frameworks such as vLLM, SGLang, or TensorRT‑LLM.
- Experience with LLM evaluation, benchmarking, and production applications, such as AI agents, coding assistants, and retrieval‑augmented generation systems.
- Experience with usage‑based pricing, token metering, billing systems, inference unit economics, or dedicated capacity commitments.
- Familiarity with enterprise requirements around data security, residency, observability, and service reliability.
- Previous hands‑on experience in software engineering, machine learning engineering, infrastructure, or developer tooling.
We’re a remote‑first collective, meeting in person twice a year to plan, brainstorm, celebrate wins, and enjoy some face‑to‑face time. We have core hours for cooperative working and calls, but outside of that your calendar is yours. Work the hours that let you perform at your peak while also building a healthy life.
Our release cycles are fast and intense, but they’re followed by real downtime. After big pushes we expect the team to unplug, recharge, and come back ready & stronger than ever for the next leap.
Generous paid time off– vacation, sick days, public holidays. Meaningful stock options– share in the upside you create. Flexible hours– own your schedule outside core collaboration blocks. Family leave– paid maternity, paternity, and caregiver time. Company retreats– twice‑yearly gatherings in inspiring locations.
Senior Product Manager - LLM Inference employer: Runware
At Runware, we pride ourselves on being an exceptional employer that fosters a remote-first culture, allowing our Senior Software Engineers to thrive in a flexible environment. With generous paid time off, meaningful stock options, and opportunities for professional growth through mentorship, we ensure our team members can balance their work and personal lives while contributing to impactful AI solutions. Our twice-yearly company retreats provide a unique chance to connect with colleagues in inspiring locations, making every moment spent with us both rewarding and enjoyable.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Product Manager - LLM Inference
✨Join Product Management Meetups
Get involved in local product management meetups or workshops. These events are perfect for meeting industry folks, sharing ideas, and staying updated on trends. Plus, you never know who might be hiring—it's a fantastic way to make connections that could lead to a job at places like Runware!
✨Show Off Your Product Sense
Create case studies or mini-projects showcasing your product management skills, and share them on platforms like Medium or LinkedIn. This not only puts your skills on display but also boosts your visibility in the product community. Imagine how impressed the hiring team at Runware would be by your initiative!
✨Utilise Online Communities
Dive into online product management communities like Product Coalition or Mind the Product. Engage in discussions, ask questions, and share your insights. These platforms are goldmines for networking and finding hidden job opportunities—many companies often scout talent from within these circles.
✨Leverage Your University Network
If you’ve recently graduated or are still in uni, tap into your alumni network for connections in product management. Many universities have their own job boards and affinity resources to help graduates land roles. Don't forget to keep an eye out for job openings at Runware through your school's career services!
We think you need these skills to ace Senior Product Manager - LLM Inference
Some tips for your application 🫡
Show Off Your Product Passion:When applying for a product management role like Senior Product Manager - LLM Inference, let your passion for developing products shine through in your cover letter. Share specific examples of products you've managed, how you solved user needs, and any successful outcomes you've achieved. This is your chance to showcase your understanding of the product lifecycle!
Highlight Your Cross-Functional Skills:Product management isn't just about understanding the product; it’s about collaborating with different teams! Make sure to emphasise your experience working with developers, designers, and marketers. Use your CV to showcase your ability to bridge gaps between these areas, and include relevant experiences that demonstrate your communication and leadership skills!
Include Your Metrics and Achievements:In a full-time product management application, data speaks volumes! Quantify your achievements wherever possible. Did you increase user retention by a certain percentage? Launch a product ahead of schedule? Include these metrics in your CV to paint a picture of your impact and effectiveness in previous roles.
Tailor Your CV to the Role:Make sure your CV is tailored for the Senior Product Manager - LLM Inference position at Runware. Use keywords from the job description and ensure your relevant experiences are front and centre. Highlight any certifications or relevant training you’ve completed that will make you stand out as a strong candidate for the role. And remember, we’re excited to see your application on our website!
How to prepare for a job interview at Runware
✨Understand the Product Life Cycle
As a product management candidate, we need to get our head around the complete product life cycle. Be prepared to discuss real-world examples of how you’ve managed product development from ideation to launch. Bring specific insights on tools like JIRA or Trello that can help streamline these processes.
✨Showcase Your Cross-Functional Skills
Product management is all about collaboration. We should be ready to highlight how we’ve worked across teams—think marketing, engineering, and design. Prepare to discuss scenarios where you had to mediate differing opinions and how you got everyone on board with a shared vision.
✨Prepare for Case Studies
In a full-time role, we can expect to encounter case study questions during our interviews. Practise solving hypothetical product problems on the spot, such as prioritising features for a new app or improving user engagement metrics. This will show our analytical thinking and decision-making skills.
✨Know Your Metrics
Let’s face it, numbers are our best friends in product management. We should prepare to discuss key performance indicators (KPIs) and how we've used analytics to inform product decisions. Dive into examples where data has driven our strategy for improvements or justified product changes.