At a Glance
- Tasks: Build and maintain benchmarks for AI safety, collaborating on evaluations for flagship models.
- Company: White Circle, a forward-thinking tech company focused on AI research.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Dynamic research environment with a focus on innovation and collaboration.
- Why this job: Join a team making a real impact in AI safety and research.
- Qualifications: Experience in Python, LLM benchmarks, and strong experimental skills.
The predicted salary is between 80000 - 100000 Β£ per year.
White Circle is seeking a research engineer to build and maintain our internal benchmark suite for single/multi-turn content and agentic safety, collaborating with product on evals for our flagship models. You will also study agent behaviours in the wild and contribute to research projects.
You will write production-grade Python, design scalable benchmarks, and extend evals to new data, drawing on experience creating LLM benchmarks and synthetic data, with strong experimental rigor.
We think you need these skills to ace AI Safety Benchmark Engineer
Python
Benchmark Design
Experimental Rigor
LLM Benchmarking
Synthetic Data Creation
Collaboration Skills
Research Skills