AI Evaluation Engineer β€” Secure, Mission-Critical Agent Metrics

AI Evaluation Engineer β€” Secure, Mission-Critical Agent Metrics

Full-Time On-site
D

Dex is partnering with a London-based sovereign AI infrastructure organization to advance secure, air-gapped data processing. You'll own the measurement layer, building rigorous Python evaluation harnesses to judge non-deterministic agent workflows and ensure genuine improvements rather than gaming metrics.

The role emphasizes statistical methods, bias detection, and calibration of LLM-as-a-judge pipelines against human annotations, with responsibility for datasets, rubrics, and repeatable

#J-18808-Ljbffr

AI Evaluation Engineer β€” Secure, Mission-Critical Agent Metrics employer: Dex

At Dex, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration. Our London-based team enjoys a hybrid working model, competitive benefits, and ample opportunities for professional growth, all while contributing to cutting-edge technology in the healthcare sector. Join us to make a meaningful impact in real-time systems and edge deployment, surrounded by a supportive team dedicated to excellence.

D

Contact Details:

Dex Recruitment Team