AI Evaluation Data Scientist

AI Evaluation Data Scientist

Full-Time 63000 - 77000 Β£ / year (est.) No working from home possible
O

At a Glance

  • Tasks: Define excellence in AI work and score samples with precision.
  • Company: Join Mercor, a leader in AI evaluation and innovation.
  • Benefits: Attractive salary, flexible working options, and opportunities for growth.
  • Other info: Collaborative environment with a focus on impactful projects.
  • Why this job: Shape the future of AI by ensuring quality and accuracy in evaluations.
  • Qualifications: 5+ years in data science, strong A/B testing skills, and clear communication.

The predicted salary is between 63000 - 77000 Β£ per year.

Mercor is seeking experienced data scientists to define what excellent work looks like and to score AI-generated and human work samples accordingly.

You will design task-specific grading criteria, provide rigorous written justifications for every score, and ensure our scoring remains reproducible and defensible.

Ideal candidates bring 5+ years in industry data science, strong experiment design and A/B testing skills, and the ability to clearly communicate findings to executive stakeholders.

#J-18808-Ljbffr

AI Evaluation Data Scientist employer: Obsidian

At Obsidian, we pride ourselves on fostering a collaborative and innovative work culture that empowers our ML Scientists to push the boundaries of machine learning research. Located in a vibrant tech hub, we offer competitive compensation, flexible project-based work, and ample opportunities for professional growth, making us an excellent employer for those looking to make a meaningful impact in the field of AI.

O

Contact Details:

Obsidian Recruitment Team

We think you need these skills to ace AI Evaluation Data Scientist

Data Science
Experiment Design
A/B Testing
Communication Skills
Analytical Skills
Scoring Methodology
Written Justification