Data Science Subject Matter Expert - AI Evaluation (UK-Remote)
Data Science Subject Matter Expert - AI Evaluation (UK-Remote)

Data Science Subject Matter Expert - AI Evaluation (UK-Remote)

Full-Time No home office possible
B

At a Glance

  • Tasks: Design and optimise data workflows for GenAI research while ensuring high-quality datasets.
  • Company: Join a leading tech company focused on innovative AI solutions.
  • Benefits: Competitive hourly pay, remote work flexibility, and potential for project extension.
  • Why this job: Make an impact in the AI field and work with cutting-edge technology.
  • Qualifications: Master’s or PhD in Data Science; strong communication and collaboration skills.
  • Other info: Fast-paced environment with opportunities for growth and learning.

Seeking multiple Data Science Subject Matter Experts to help design, run, and optimize data collection and evaluation workflows for GenAI research. You’ll translate high-level research needs into scalable processes, produce and curate challenging domain problems, and ensure factual, bias-aware, high-quality datasets for LLM training.

To Note: This is for an immediate project need. Project is approved for 3-months initially, with possibility to extend based on project/client demands.

Responsibilities:

  • Partner with GenAI researchers/engineers to capture data needs and success criteria.
  • Expand high-level requirements into clear, executable workflows for larger teams.
  • Execute collection/evaluation workflows rapidly with minimal supervision.
  • Innovate on workflows to maximize throughput and quality.
  • Collaborate cross-functionally to maintain quality at scale.
  • Conduct in-depth LLM-assisted research; gather reliable, up-to-date info.
  • Craft original, high-quality content and hard problems for LLM eval/train.
  • Perform rigorous fact-checking (precision/recall) to prevent misinformation.

Requirements:

  • Education: Master’s with distinction or PhD in Data Science; top-tier institution preferred. Significant domain experience considered.
  • Detail orientation; precise data presentation; thorough proofreading.
  • Communication: articulate complex info; strong collaboration.
  • Understanding of AI/LLMs, their capabilities/limits.
  • Prompt engineering and familiarity with AI writing tools.
  • Ethical AI awareness and data literacy (collection, cleaning, transformation).
  • Thrives in fast-paced, minimally supervised environments.

Data Science Subject Matter Expert - AI Evaluation (UK-Remote) employer: Braintrust

At Braintrust, we pride ourselves on being an exceptional employer that fosters a collaborative and innovative work culture. As a Data Science Subject Matter Expert, you'll have the opportunity to work remotely in the UK, enjoying flexible hours and competitive pay while contributing to cutting-edge AI research. We are committed to your professional growth, offering unique projects that challenge your skills and encourage continuous learning in a supportive environment.
B

Contact Detail:

Braintrust Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Data Science Subject Matter Expert - AI Evaluation (UK-Remote)

✨Tip Number 1

Network like a pro! Reach out to your connections in the data science field and let them know you're on the lookout for opportunities. You never know who might have a lead or can refer you to someone looking for a Data Science Subject Matter Expert.

✨Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those related to AI evaluation and data workflows. This will give potential employers a taste of what you can do and set you apart from the crowd.

✨Tip Number 3

Prepare for interviews by brushing up on your knowledge of LLMs and AI tools. Be ready to discuss how you've tackled complex data challenges in the past. We want to see your problem-solving skills in action!

✨Tip Number 4

Don't forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!

We think you need these skills to ace Data Science Subject Matter Expert - AI Evaluation (UK-Remote)

Data Collection and Evaluation Workflows
Domain Problem Curation
Dataset Quality Assurance
Collaboration with Researchers/Engineers
Workflow Optimization
LLM-Assisted Research
Content Creation for LLM Training
Fact-Checking Skills
Detail Orientation
Communication Skills
Understanding of AI/LLMs
Prompt Engineering
Ethical AI Awareness
Data Literacy

Some tips for your application 🫡

Tailor Your CV: Make sure your CV is tailored to the Data Science Subject Matter Expert role. Highlight your relevant experience in AI evaluation and data collection workflows, and don’t forget to showcase any projects that demonstrate your skills in crafting high-quality datasets.

Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you’re passionate about AI and data science. Mention specific experiences that align with the responsibilities listed in the job description, and show us how you can contribute to our team.

Showcase Your Communication Skills: Since this role involves collaboration and articulating complex information, make sure your application reflects your communication skills. Use clear, concise language and structure your documents well to make it easy for us to see your thought process.

Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you get all the updates directly from us. Plus, it shows you’re keen on joining our team!

How to prepare for a job interview at Braintrust

✨Know Your Data Science Stuff

Make sure you brush up on your data science knowledge, especially around AI and LLMs. Be ready to discuss your experience with data collection, evaluation workflows, and any relevant projects you've worked on. This will show that you understand the role and can hit the ground running.

✨Prepare for Technical Questions

Expect some technical questions during the interview. Practice explaining complex concepts in simple terms, as you'll need to articulate your ideas clearly. Think about how you would translate high-level research needs into executable workflows, and be prepared to share examples from your past work.

✨Show Your Collaboration Skills

Since this role involves working closely with GenAI researchers and engineers, highlight your teamwork experience. Share specific instances where you collaborated cross-functionally to achieve a goal, and emphasise your ability to maintain quality at scale while working with others.

✨Demonstrate Ethical Awareness

Given the focus on ethical AI and data literacy, be ready to discuss your understanding of these topics. Talk about how you ensure factual accuracy and prevent misinformation in your work. This will show that you're not just technically skilled but also aware of the broader implications of your work.

Data Science Subject Matter Expert - AI Evaluation (UK-Remote)
Braintrust

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

B
Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>