Senior LLM Evaluation Engineer - Code & AI Systems

Senior LLM Evaluation Engineer - Code & AI Systems

Full-Time 63000 - 77000 Β£ / year (est.) No working from home possible
B

At a Glance

  • Tasks: Design coding tasks and evaluate AI model outputs to enhance software quality.
  • Company: Join Braintrust, a forward-thinking team in AI and software engineering.
  • Benefits: Flexible contracting role with potential for long-term collaboration.
  • Why this job: Make a real impact on AI systems and improve code reliability.
  • Qualifications: Experience in software engineering and a passion for AI evaluation.

The predicted salary is between 63000 - 77000 Β£ per year.

Braintrust is seeking an experienced software engineer to join our evaluation and annotation team.

The role focuses on real-world software engineering, model evaluation, and applied AI to improve model reliability, reasoning, and code quality.

You will design challenging coding tasks, evaluate model outputs against benchmarks, and contribute to reinforcement learning and model improvement workflows.

This is a contracting engagement with potential for long-term collaboration.

#J-18808-Ljbffr

Senior LLM Evaluation Engineer - Code & AI Systems employer: Braintrust

Braintrust is an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration in the rapidly evolving AI landscape. As a Remote Regional Sales Director in EMEA, you will benefit from flexible time off, competitive salary and equity, and a supportive environment that prioritises employee growth and development. Join us to lead a high-performing sales team and make a significant impact in shaping the future of AI observability while enjoying perks like daily lunches and an AI stipend.

B

Contact Details:

Braintrust Recruitment Team

We think you need these skills to ace Senior LLM Evaluation Engineer - Code & AI Systems

Software Engineering
Model Evaluation
Applied AI
Coding Task Design
Benchmark Evaluation
Reinforcement Learning
Model Improvement Workflows