CoreWeave is seeking an experienced Staff Software Engineer for the Inference team to lead architecture, performance, and reliability across multi-team services. You will shape cross-cutting design initiatives in request routing, scheduling, and GPU resource management, targeting strict P99 SLAs.
You will implement advanced optimizations like speculative decoding and KV-cache reuse while establishing benchmarking and observability practices across infrastructure boundaries.
#J-18808-LjbffrSenior AI Inference Platform Architect employer: CoreWeave
CoreWeave is an exceptional employer, offering a dynamic work environment in Greater London where innovation meets reliability. With comprehensive benefits such as family-level medical and dental insurance, pension contributions, and tuition reimbursement, employees are supported both personally and professionally. The company fosters a culture of growth and collaboration, ensuring that every Data Centre Technician has the opportunity to develop their skills while contributing to cutting-edge data centre operations.
