AI (Agent Focus) Subject Matter Expert - AI Evaluation (UK-Remote) in Birmingham

1 day ago Be among the first 25 applicants

This range is provided by Braintrust. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$75.00/hr – $90.00/hr

Job Description

Seeking multiple AI (Agent Space focused) Subject Matter Experts to help design, run, and optimize data collection and evaluation workflows for GenAI research.

You’ll translate high-level research needs into scalable processes, produce and curate challenging domain problems, and ensure factual, bias‑aware, high-quality datasets for LLM training.

• To Note: This is for an immediate project need. Project is approved for 3‑months initially, with possibility to extend based on project/client demands.
• To Note: Hourly rate range (75 – 90) is in USD per hour

Responsibilities

• Partner with GenAI researchers/engineers to capture data needs and success criteria.
• Expand high-level requirements into clear, executable workflows for larger teams.
• Execute collection/evaluation workflows rapidly with minimal supervision.
• Innovate on workflows to maximize throughput and quality.
• Collaborate cross-functionally to maintain quality at scale.
• Conduct in‑depth LLM‑assisted research; gather reliable, up‑to‑date info.
• Craft original, high‑quality content and hard problems for LLM eval/train.
• Perform rigorous fact‑checking (precision/recall) to prevent misinformation.

Requirements

• Education: Master’s with distinction or PhD in AI; top‑tier institution preferred. Significant domain experience considered.
• Detail orientation; precise data presentation; thorough proofreading.
• Communication: articulate complex info; strong collaboration.
• Understanding of AI/LLMs, their capabilities/limits.
• Prompt engineering and familiarity with AI writing tools.
• Ethical AI awareness and data literacy (collection, cleaning, transformation).
• Thrives in fast‑paced, minimally supervised environments.

Seniority level

• Entry level

Employment type

• Full‑time

Job function

• Information Technology

Industries

• Technology, Information and Internet and IT Services and IT Consulting

Referrals increase your chances of interviewing at Braintrust by 2x

Get notified about new Artificial Intelligence Consultant jobs in Birmingham, England, United Kingdom.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.