LLM Inference & Serving Engineer

LLM Inference & Serving Engineer

Full-Time On-site
M

Mistral AI is seeking a senior engineer to own and optimize the inference stack, engine orchestration, and scalable serving for frontier AI models. You will work on production-grade ML/LLM services, capacity sizing, and training-serving pipelines to keep models responsive and cost-efficient.

The role emphasizes building high-performance serving systems, with hands-on experience in vLLM, SGLang, or TensorRT-LLM, and deep CUDA/NCCL knowledge. Hybrid work in London area is supported.

#J-18808-Ljbffr

LLM Inference & Serving Engineer employer: Mistral AI

Mistral AI is an exceptional employer that fosters a culture of innovation and collaboration, making it an ideal place for a WAN & Edge Network Automation Engineer to thrive. With a strong emphasis on employee growth, you will have access to continuous learning opportunities and cutting-edge projects that challenge your skills. Located in a vibrant tech hub, the company offers a dynamic work environment where creativity and teamwork are highly valued, ensuring that every team member contributes to meaningful advancements in network automation.

M

Contact Details:

Mistral AI Recruitment Team