At a Glance
- Tasks: Design and prototype AI/ML methods to improve data quality and support AI evaluation workflows.
- Company: Join a forward-thinking team focused on real-world applications of AI and ML.
- Benefits: 12-month fixed-term contract with opportunities for impactful work in applied ML.
- Other info: Experience with human-in-the-loop AI systems is essential.
- Why this job: Ideal for those with strong applied ML skills looking to make a real-world impact.
- Qualifications: PhD or MSc in relevant fields and 3+ years of applied ML or data science experience required.
The predicted salary is between 70000 - 90000 Β£ per year.
Requirements
- Ideal for someone with deep scientific judgement, strong applied ML skills, and a practical bias toward methods that work in real customer and product contexts.
- PhD or MSc in Computer Science, Mathematics, Statistics, Machine Learning, or a related field.
- 3+ years of applied ML, AI research, or data science experience with demonstrated real-world impact.
- Experience with human-in-the-loop AI systems, including RLHF, annotation pipelines, data quality modelling, judgement aggregation, benchmarks, or AI evaluation.
- Fluency with modern LLM and agentic techniques, such as Retrieval-Augmented Generation (RAG), LLM-as-judge, multi-agent workflows, synthetic data generation, and automated quality review.
- Strong Python skills and the ability to quickly build, test, and iterate on working prototypes.
- Good judgement on when to use simple statistical methods, classical ML, LLMs, or agentic approaches.
- Ability to translate ambiguous product or customer problems into clear hypotheses, experiments, metrics, and reusable methodologies.
- Strong cross-functional communication and experience partnering with product and engineering teams.
What the job involves
- As an Applied Scientist, you will design and prototype AI/ML methods that improve data quality, scale human judgement, and support robust AI evaluation workflows.
- You will work on applied problems such as quality modelling, judgement aggregation, evaluation design, LLM-assisted review, and reliability testing for AI systems.
- This is not a pure research role or a production ML engineering role. You will turn ambiguous problems into clear methodologies, benchmarks, models, and prototypes that product and engineering teams can adopt.
- Prototype AI/ML methods to improve human data quality, judgement aggregation, and AI evaluation workflows.
- Design experiments, benchmarks, and reliability tests to measure whether new methods improve quality, efficiency, or customer outcomes.
- Apply classical ML, statistics, LLMs, and agentic techniques where they create practical value.
- Use modern AI tools to accelerate prototyping, experimentation, and iteration.
- Partner closely with product and engineering to translate scientific methods into scalable platform capabilities.
- Communicate technical assumptions, trade-offs, and recommendations clearly across technical and non-technical teams.
Lead Applied Scientist (12 Month Fixed Term Contract) employer: Prolific
This role is based in a dynamic environment where you can leverage your expertise in AI/ML. The team values practical solutions that enhance customer outcomes, offering a unique opportunity to influence product development. Enjoy a collaborative atmosphere while working on cutting-edge technology.
We think you need these skills to ace Lead Applied Scientist (12 Month Fixed Term Contract)
Applied Machine Learning
AI Research
Data Science
Human-in-the-Loop AI Systems
Reinforcement Learning from Human Feedback (RLHF)
Data Quality Modelling
Judgement Aggregation