Application Engineer - Distributed Computing

Distributed Computing Application Engineer – Systematic Hedge Fund – London

Our client, a leading systematic hedge fund, is seeking a Distributed Computing Application Engineer to join their London-based team. This role involves collaborating across multiple business units to architect and optimise large-scale, compute-intensive work flows spanning global locations.

You will work with cutting-edge platforms such as Ray and YellowDog, driving the integration and support of distributed computing solutions to enhance performance and scalability in complex environments.

Key Responsibilities:

• Partner with business teams to embed distributed computing into core workflows.
• Optimise applications for high performance on distributed platforms.
• Provide architectural and technical leadership in the design and development of distributed systems.
• Design, implement, and manage distributed computing solutions using Ray and YellowDog.

Required Skills & Experience:

• Bachelor\’s degree in Computer Science, Engineering, or a related field.
• Deep understanding of loosely and tightly coupled workloads.
• Hands-on experience with HPC platforms and job/resource scheduling.
• Proficiency in cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).
• Proven experience working with large-scale systems (1000+ nodes, 10,000+ tasks).
• Advanced expertise in Ray for machine learning pipelines, hyperparameter tuning, and distributed execution.
• Strong programming skills in Python and experience with Conda.
• Proficiency with Docker and Kubernetes for containerisation and orchestration.