At a Glance
- Tasks: Design and optimise data workflows for GenAI research while ensuring high-quality datasets.
- Company: Join a leading AI research team focused on innovative data solutions.
- Benefits: Competitive hourly rate, remote work flexibility, and potential for project extension.
- Why this job: Make an impact in AI by crafting original content and solving challenging problems.
- Qualifications: Master’s or PhD in Data Science with strong writing and research skills.
- Other info: Fast-paced environment with opportunities for creativity and collaboration.
The predicted salary is between 52 - 63 £ per hour.
Seeking multiple Data Science Subject Matter Experts to help design, run, and optimize data collection and evaluation workflows for GenAI research. You’ll translate high-level research needs into scalable processes, produce and curate challenging domain problems, and ensure factual, bias-aware, high-quality datasets for LLM training.
To Note: This is for an immediate project need. Project is approved for 3-months initially, with possibility to extend based on project/client demands. Hourly rate range (75 - 90) is in USD per hour.
Responsibilities:
- Partner with GenAI researchers/engineers to capture data needs and success criteria.
- Expand high-level requirements into clear, executable workflows for larger teams.
- Execute collection/evaluation workflows rapidly with minimal supervision.
- Innovate on workflows to maximize throughput and quality.
- Collaborate cross-functionally to maintain quality at scale.
- Conduct in-depth LLM-assisted research; gather reliable, up-to-date info.
- Craft original, high-quality content and hard problems for LLM eval/train.
- Perform rigorous fact-checking (precision/recall) to prevent misinformation.
Requirements:
- Education: Master’s with distinction or PhD in Data Science; top-tier institution preferred. Significant domain experience considered.
- Content development expertise across Data Science.
- Exceptional writing: clear, concise, engaging; across formats.
- Strong research & fact-checking; bias mitigation.
- Originality/creativity; distinct human voice.
- Detail orientation; precise data presentation; thorough proofreading.
- Communication: articulate complex info; strong collaboration.
- Understanding of AI/LLMs, their capabilities/limits.
- Prompt engineering and familiarity with AI writing tools.
- Ethical AI awareness and data literacy (collection, cleaning, transformation).
- Thrives in fast-paced, minimally supervised environments.
Data Science Subject Matter Expert - AI Evaluation (UK-Remote) in Edinburgh employer: Braintrust
Contact Detail:
Braintrust Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Science Subject Matter Expert - AI Evaluation (UK-Remote) in Edinburgh
✨Tip Number 1
Network like a pro! Reach out to your connections in the data science field and let them know you're on the lookout for opportunities. You never know who might have a lead or can refer you directly to hiring managers.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your best work in data science, especially projects related to AI evaluation. This will give potential employers a taste of what you can bring to the table.
✨Tip Number 3
Prepare for interviews by brushing up on your knowledge of LLMs and AI tools. Be ready to discuss how you've tackled complex problems in the past and how you can contribute to optimising workflows in this role.
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Data Science Subject Matter Expert - AI Evaluation (UK-Remote) in Edinburgh
Some tips for your application 🫡
Show Off Your Expertise: Make sure to highlight your experience in Data Science and any relevant projects you've worked on. We want to see how you can translate high-level research needs into actionable workflows, so don’t hold back!
Be Clear and Concise: Your writing should be engaging and easy to understand. We’re looking for exceptional writing skills, so keep it clear and concise while showcasing your unique voice. Remember, less is often more!
Demonstrate Your Research Skills: Since this role involves a lot of fact-checking and data evaluation, make sure to mention your research capabilities. Show us how you gather reliable information and mitigate bias in your work.
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and get to know you better. Don’t miss out on this opportunity!
How to prepare for a job interview at Braintrust
✨Know Your Data Science Stuff
Make sure you brush up on your data science knowledge, especially around AI and LLMs. Be ready to discuss your experience with data collection, evaluation workflows, and how you've tackled bias in datasets. This will show that you’re not just a theorist but someone who can apply their knowledge practically.
✨Showcase Your Collaboration Skills
Since the role involves partnering with researchers and engineers, be prepared to share examples of how you've successfully collaborated in the past. Highlight any cross-functional projects you've worked on and how you contributed to maintaining quality at scale.
✨Prepare for Problem-Solving Questions
Expect to face questions that assess your ability to create challenging domain problems for LLM training. Think of specific scenarios where you had to innovate on workflows or solve complex issues, and be ready to explain your thought process clearly.
✨Communicate Clearly and Confidently
Your writing and communication skills are crucial for this role. Practice articulating complex information in a clear and engaging way. You might even want to prepare a short presentation on a relevant topic to demonstrate your ability to convey ideas effectively during the interview.