Physics Subject Matter Expert - AI Evaluation (UK-Remote) in Birmingham

Overview

Seeking multiple Physics Subject Matter Experts to help design, run, and optimize data collection and evaluation workflows for GenAI research. You’ll translate high‑level research needs into scalable processes, produce and curate challenging domain problems, and ensure factual, bias‑aware, high‑quality datasets for LLM training.

Project Details

• Project is approved for 3‑months initially, with possibility to extend based on project/client demands.
• Fixed hourly rate: USD $75/hr.
• Immediate project need.

Responsibilities

• Partner with GenAI researchers/engineers to capture data needs and success criteria.
• Expand high‑level requirements into clear, executable workflows for larger teams.
• Execute collection/evaluation workflows rapidly with minimal supervision.
• Innovate on workflows to maximize throughput and quality.
• Collaborate cross‑functionally to maintain quality at scale.
• Conduct in‑depth LLM‑assisted research; gather reliable, up‑to‑date info.
• Craft original, high‑quality content and hard problems for LLM evaluation and training.
• Perform rigorous fact‑checking (precision/recall) to prevent misinformation.

Requirements

• Education: Master’s with distinction or PhD in Physics; top‑tier institution preferred. Significant domain experience considered.
• Detail orientation; precise data presentation; thorough proofreading.
• Communication: articulate complex information; strong collaboration.
• Understanding of AI/LLMs, their capabilities and limits.
• Prompt engineering and familiarity with AI writing tools.
• Ethical AI awareness and data literacy (collection, cleaning, transformation).
• Thrives in fast‑paced, minimally supervised environments.

Seniority Level

• Not Applicable

Employment Type

• Full‑time

Job Function

• Research, Analyst, and Science

Industry

• Higher Education and Education

Birmingham, England, United Kingdom