Senior/Lead Research Scientist, Model Evaluations in London

Senior/Lead Research Scientist, Model Evaluations in London

London Full-Time 72000 - 88000 £ / year (est.) Hybrid
Thomson Reuters

At a Glance

  • Tasks: Lead cutting-edge AI evaluations and collaborate with experts to enhance model performance.
  • Company: Join Thomson Reuters, a leader in trusted content and technology for professionals.
  • Benefits: Enjoy flexible work arrangements, competitive benefits, and a focus on mental wellbeing.
  • Other info: Be part of a diverse team committed to inclusion, growth, and social impact.
  • Why this job: Make a real-world impact by shaping the future of AI in professional workflows.
  • Qualifications: PhD or equivalent experience in AI research, with hands-on evaluation expertise.

The predicted salary is between 72000 - 88000 £ per year.

Thomson Reuters Labs builds and ships custom models for professional workflows requiring fiduciary-grade AI. The Thomson LLM family was developed by training leading open-weight models on decades of authoritative Thomson Reuters content, with thousands of hours of subject-matter-expert input. Owning the model layer is how we earn trust in the most regulated, highest-stakes professional workflows.

The evaluation team focuses on providing signal for model development and adoption using a combination of benchmarks and targeted evaluations to assess performance on highly complex legal and professional workflows. The team works with legal experts to adapt their expertise into benchmarks and with product leaders to ensure model capabilities are aligned with real, user-facing flows in professional work.

As a research scientist on the team, you would be working with researchers to design, develop, optimize and scale the evaluation suite as Thomson scales to newer releases and product integrations. You’ll work in cutting edge areas of AI development, such as multi-agent systems and decision models to keep the Thomson model suite at the frontier of specialized professional LLMs.

Key Responsibilities

  • Build and operate the evaluation suite that runs Thomson evaluations.
  • Leverage our existing suite to identify and understand the strengths and weaknesses of Thomson.
  • Create new evaluations to meet the gaps in our coverage, based on a combination of product, external, and aspirational use cases for the model.
  • Lead cross-functional teams in the creation of evaluation assets.
  • Use your technical expertise to guide teams of scientists, engineers, and subject-matter experts working on evaluations and benchmarks.
  • Mentor junior scientists in developing their own research and technical skills.
  • Inform the technical direction of Thomson.
  • Propose opportunities for improvements on topics such as more robust and reliable evaluation, new opportunities for applying LLMs, and optimizations on existing assets.
  • Draw on evaluation results to inform our training objectives.
  • Provide recommendations to senior leadership on technical trade-offs in model development.
  • Conduct fundamental research.
  • Develop new ideas in model evaluation across science of evaluations, new benchmarks, and safety and alignment.
  • Publish research findings in top AI/ML/NLP conferences on a regular cadence.
  • Integrate new research findings into model development and product pipelines.

Required Qualifications

  • Hands-on research experience in evaluations – with examples of designing, building and releasing benchmarks for frontier models or agents, including research publications in top conferences such as NeurIPS/ICML/ICLR/*ACL.
  • Experience working closely with researchers and cross-functional stakeholders to translate ideas into practical evaluations.
  • Hands-on Python coding experience implementing benchmarks, agents or other systems built around LLMs.
  • Familiarity with current developments in LLMs, with an interest in staying up to date with the evolving frontier.
  • A PhD in Computer Science or a related field, or equivalent practical experience, plus industry experience working on post-training or evaluation.
  • Professional experience will be considered as a factor for levelling between Senior and Lead.

Preferred Qualifications

  • Experience working with specialized domain experts in areas such as law, tax, or similar professions is especially desirable.
  • Familiarity with AI-assisted coding and with leveraging coding agents at scale to accelerate work.
  • Experience in experimental design and best practices for working with human data.

Even if you don’t have all the above requirements, we encourage you to apply to explore a mutual fit!

What’s in it For You?

  • Hybrid Work Model: We’ve adopted a flexible hybrid working environment for our office-based roles while delivering a seamless experience that is digitally and physically connected.
  • Flexibility & Work-Life Balance: Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset.
  • Career Development and Growth: By fostering a culture of continuous learning and skill development, we prepare our talent to tackle tomorrow’s challenges and deliver real-world solutions.
  • Industry Competitive Benefits: We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing.
  • Culture: Globally recognized, award-winning reputation for inclusion and belonging, flexibility, work-life balance, and more.
  • Social Impact: Make an impact in your community with our Social Impact Institute. We offer employees two paid volunteer days off annually and opportunities to get involved with pro-bono consulting projects and Environmental, Social, and Governance (ESG) initiatives.
  • Making a Real-World Impact: We are one of the few companies globally that helps its customers pursue justice, truth, and transparency.

Senior/Lead Research Scientist, Model Evaluations in London employer: Thomson Reuters

Thomson Reuters is an exceptional employer, offering a dynamic work environment where innovation thrives and employees are empowered to lead the development of cutting-edge AI solutions. With a strong commitment to work-life balance, comprehensive benefits, and a culture that prioritises inclusion and professional growth, employees can expect to make a meaningful impact while advancing their careers in a globally recognised organisation. The hybrid work model and opportunities for community engagement further enhance the appeal of working in London, a vibrant hub for technology and legal expertise.

Thomson Reuters

Contact Details:

Thomson Reuters Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Senior/Lead Research Scientist, Model Evaluations in London

✨Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Thomson Reuters!

✨Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Senior/Lead Research Scientist, Model Evaluations at Thomson Reuters.

✨Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Thomson Reuters.

✨Apply Directly through Our Website

When you find a suitable opening like Senior/Lead Research Scientist, Model Evaluations at Thomson Reuters, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Senior/Lead Research Scientist, Model Evaluations in London

Research Experience in Evaluations
Benchmark Design and Development
Python Coding
Familiarity with LLMs
Cross-Functional Collaboration
Experimental Design
Mentoring Skills

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at Thomson Reuters, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Thomson Reuters. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at Thomson Reuters

✨Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

✨Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

✨Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Thomson Reuters!

✨Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.