Scale AI is seeking a Software Engineer on the ML Infrastructure team to design and build platforms for scalable, reliable serving of LLMs. You will collaborate with researchers and engineers to productionize models, ensuring high-performance, fault-tolerant systems across environments.
The ideal candidate has strong ML fundamentals and deep backend system design experience, with hands-on skills in Python, Go, Rust, or C++, and experience with Docker, Kubernetes, and cloud infrastructure.
#J-18808-Ljbffr
LLM Serving Platform Engineer employer: scaleai
Scale is an exceptional employer that fosters a collaborative and innovative work culture in the heart of London. With a strong emphasis on employee growth, you will have access to continuous learning opportunities and the chance to work on cutting-edge multi-cloud deployments. The company values end-to-end ownership, allowing you to make a meaningful impact while enjoying a supportive environment that encourages cross-functional teamwork.