Senior AI Platform Engineer – LLM Inference Backend

Senior AI Platform Engineer – LLM Inference Backend

Full-Time 80000 - 100000 Β£ / year (est.) No working from home possible
Jpmorgan Chase & Co.

At a Glance

  • Tasks: Build backend services for LLM inference and scalable production systems.
  • Company: Join JPMorgan Chase & Co., a leader in financial services.
  • Benefits: Competitive salary, health benefits, and opportunities for professional growth.
  • Other info: Collaborative environment with strong focus on innovation and security.
  • Why this job: Work on cutting-edge AI technology and make a real impact in finance.
  • Qualifications: Experience in software engineering and knowledge of AI platforms.

The predicted salary is between 80000 - 100000 Β£ per year.

JPMorgan Chase & Co. is hiring a Software Engineer III in London to build backend services for LLM inference and scalable production systems. You will work on routing, batching, scheduling, streaming responses, and quota management while improving APIs, observability, and reliability across the platform. You will explore model architectures, tokenization costs, and GPU utilization, collaborating with product teams and using enterprise AI tooling to boost performance and security of critical.

Senior AI Platform Engineer – LLM Inference Backend employer: Jpmorgan Chase & Co.

JPMorgan Chase & Co. is an exceptional employer, offering a dynamic work environment in Bournemouth where innovation and collaboration thrive. Employees benefit from a strong focus on professional development, inclusive team culture, and the opportunity to work with cutting-edge technology in a supportive atmosphere that values continuous improvement and engineering excellence.

Jpmorgan Chase & Co.

Contact Details:

Jpmorgan Chase & Co. Recruitment Team

We think you need these skills to ace Senior AI Platform Engineer – LLM Inference Backend

Backend Development
LLM Inference
API Improvement
Observability
Reliability Engineering
Routing
Batching