Callosum is building a unified benchmarking system for evaluating agentic and algorithmic AI work. The role focuses on reproducible, contamination‑controlled evaluation across motifs and decomposition strategies, grounded in real execution traces and sandboxed grading.
You will architect and implement pipelines that measure task success, quality and robustness, influencing which approaches ship and how we communicate proof points to customers.
#J-18808-Ljbffr
AI Benchmarking Architect employer: AI Startups UK
Lovable is an exceptional employer for data scientists, particularly in our dynamic London growth team. With a culture of extreme ownership and low-ego collaboration, we empower our employees to drive impactful growth metrics while working alongside talented engineers. Our commitment to innovation and rapid experimentation offers unparalleled opportunities for professional development, making Lovable a truly rewarding place to build your career.
