hackajob is partnering directly with JPMorganChase to hire for this role.
JOB DESCRIPTION
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.
As a Software Engineer III at JPMorganChase within the Firmwide LLM Serving Platform team, you are an integral part of an agile team that designs, builds, and operates the services that make large language models usable at scale. This is an infrastructure-meets-ML role: you don't need to be an ML researcher, but you should be excited to learn how model architectures and inference constraints translate into real production systems. You will contribute to a living platform where we optimize performance - pushing down latency, increasing throughput, maximizing GPU utilization, and eliminating waste across the request lifecycle.
Job responsibilities
-
Build core backend services for LLM inference, including request routing, batching, scheduling, streaming responses, and quota/limits.
-
Implement and maintain APIs and SDKs used by product and application teams across the firm.
-
Profile and optimize performance end-to-end across CPU, memory, network, serialization, concurrency, GPU utilization, and caching.
-
Improve reliability and operability through health checks, graceful degradation, autoscaling behaviors, incident follow-...
Software Engineer III - Data Analytics Platform in London employer: Hackajob
Joining Google as a Security Platform Engineer in the UK Public Sector means becoming part of a dynamic and innovative team dedicated to delivering secure private cloud services for critical customers. With a strong emphasis on employee growth, you will have access to cutting-edge technology and collaborative opportunities that foster professional development. The inclusive work culture at Google encourages creativity and teamwork, making it an exceptional employer for those seeking meaningful and impactful work in a supportive environment.
