Lead LLM Infra & Reliability Engineer

Lead LLM Infra & Reliability Engineer

Full-Time 60000 - 80000 £ / year (est.) No working from home possible
JPMorganChase

At a Glance

  • Tasks: Build and manage large language model infrastructure for optimal performance and reliability.
  • Company: Join JPMorgan Chase, a leading financial institution with a strong tech focus.
  • Benefits: Attractive salary, health benefits, and opportunities for professional growth.
  • Other info: Dynamic work environment with excellent career advancement potential.
  • Why this job: Be at the forefront of AI technology and make a significant impact in the industry.
  • Qualifications: Experience in cloud deployments, Kubernetes, and LLM technologies required.

The predicted salary is between 60000 - 80000 £ per year.

JPMorgan Chase in Glasgow, United Kingdom, is seeking a Lead Software Engineer to build and operate large language model serving infrastructure at scale. You will own reliability, performance, and cost‑efficiency of the LLM platform end to end, and work hands‑on with cloud and Kubernetes deployments.

You will deploy and manage LLM serving stacks (vLLM, llm-d) on Amazon EKS, SageMaker and on‑prem GPUs, with strong observability, incident response, and cost‑aware performance tuning.

Lead LLM Infra & Reliability Engineer employer: JPMorganChase

JPMorganChase is an exceptional employer, offering a dynamic work environment in Greater London where innovation thrives. With a strong commitment to diversity and inclusion, employees benefit from collaborative agile teams, extensive professional development opportunities, and the chance to work on cutting-edge technology products that shape the future of finance. Join us to be part of a culture that values your contributions and supports your growth.

JPMorganChase

Contact Details:

JPMorganChase Recruitment Team

We think you need these skills to ace Lead LLM Infra & Reliability Engineer

Large Language Model (LLM) Infrastructure
Reliability Engineering
Performance Tuning
Cost-Efficiency Management
Cloud Deployments
Kubernetes
Amazon EKS