Senior Product Engineer (Agent Training and Evals)
Remote, UK
The role
As a Senior Product Engineer, you'll be one of the early engineers in our Agentic Training & Evals team.
You'll build the infrastructure that lets us evaluate AI agents, alongside real human expert work in safe and secure environments.
This is a genuine 0→1 role. There isn't a well-established playbook or existing architecture for you to simply maintain. You'll have significant influence and ownership over the technical direction of the team and the products we build.
You'll work closely with engineering, product and AI research to turn ambiguous problems into scalable systems, and you'll see the impact of what you build directly.
What you’ll bring to the role
- Strong experience building scalable infrastructure or distributed systems in the cloud
- Solid understanding of how systems are deployed, scaled and secured
- Hands‑on experience with evaluating AI models or agents
- Interest in how AI agents are trained, evaluated and improved
- Bonus: experience with image, video, or audio processing
- Strong product mindset with a focus on delivering business and customer value
- Comfort with ambiguity, and the ability to move quickly from idea to working system
- Strong communication and collaboration skills
- Python experience is useful, but not essential
What you’ll be doing in the role
- Solve hard problems around compute, orchestration, scaling, security and reliability
- Help develop approaches for training, benchmarking and evaluating AI agents
#J-18808-Ljbffr
Senior Product Engineer (Agent Training and Evals) New Remote, UK employer: Prolific
Prolific is an exceptional employer that places you at the cutting edge of AI innovation, offering a unique opportunity to work on multimodal data collection that shapes the future of technology. With a mission-driven culture, competitive salary packages, and a commitment to employee growth, Prolific fosters an inclusive environment where your contributions directly impact groundbreaking research. Enjoy the flexibility of remote working while being part of a team dedicated to ethical data practices and diverse human perspectives.
