Back End Developer in London

AI products are only as good as the systems behind them.

This is an opportunity to join a well-funded AI scale-up building technology that moves beyond simple chatbot interactions. The product is focused on solving real-world problems through intelligent automation, long-running workflows and highly reliable AI systems that users can genuinely depend on.

Backed by significant investment and led by an ambitious engineering team, the company is now looking for Backend Engineers to help build the infrastructure that powers every AI interaction across its platform.

If you're excited by distributed systems, production AI and solving complex engineering challenges at scale, this is the kind of role where your work will have immediate impact.

You’ll sit at the heart of the AI platform, building the inference and orchestration layer that connects foundation models with real users.

Your focus will be on creating backend systems that are fast, reliable and observable, ensuring AI-powered features perform consistently in production while handling the complexities of multi-step reasoning, tool integrations and long-running workflows.

Working closely with product and machine learning engineers, you’ll help transform cutting‑edge AI capabilities into production‑grade services used across multiple applications.

• Build and operate backend services that power AI features in production.
• Design inference pipelines and orchestration systems for complex AI workflows.
• Manage routing, caching, batching, streaming and request lifecycle management.
• Improve latency, throughput, scalability and cost efficiency across AI infrastructure.
• Build resilient systems capable of handling unpredictable model behaviour and external dependencies.
• Develop robust observability through logging, tracing and debugging.
• Collaborate with ML and Product teams to deliver reliable APIs and production‑ready AI services.

You’ll likely have experience with some of the following:

• Strong backend engineering experience within production environments.
• Experience building high-throughput, low-latency distributed systems.
• Exposure to modern AI technologies including LLMs, embeddings or multimodal models.
• A pragmatic mindset with a focus on shipping high-quality software and continuously improving through production learnings.

You’ll be working with technologies including:

• OpenAI, Anthropic and open-source LLMs

You’ll be joining a highly talented engineering team where you’ll work on genuinely challenging technical problems at the forefront of AI infrastructure.