Senior AI Evaluation Engineer (Data Scientist)

Senior AI Evaluation Engineer (Data Scientist)

Full-Time 56700 - 69300 £ / year (est.) Hybrid
I

At a Glance

  • Tasks: Lead the evaluation of AI products, focusing on accuracy, bias, and safety.
  • Company: Join the Incubator for AI, a dynamic team transforming public services with cutting-edge technology.
  • Benefits: Career-defining projects, generous leave, hybrid working, and personal growth opportunities.
  • Other info: Collaborate with top talent and access frontier models in a supportive environment.
  • Why this job: Make a real impact on citizens' lives by shaping innovative AI solutions.
  • Qualifications: Experience in evaluating AI systems, proficiency in Python, and strong communication skills.

The predicted salary is between 56700 - 69300 £ per year.

  • Applications for this position close on 3rd November 2026 - 23.45pm UK Time
  • Incubator for AI, i. AI
  • Help shape how people interact with some of the most ambitious AI products in government

The Incubator for AI (i.

AI) is a team of ~80 builders and operators using frontier AI to improve public services across healthcare, education, planning and parliament.

We combine startup pace and autonomy with the opportunity to tackle national-scale challenges.

We operate under three core principles

Talent : We bring together the UK's best AI talent across a range of functions.

You will work alongside exceptional researchers and top government leaders, staying at the cutting edge of technology.

Innovation : We set precedents for what is possible in government.

We combine the pace of a start-up with the influence of being at the digital centre of government.

You will test new ideas, expand what is possible, and leverage unique government data to create novel solutions.

Impact : We are dedicated to using AI as a tool for public good - this can mean improving outcomes in schools, boosting housebuilding or providing more personalised support for those in need.

With the backing of the Prime Minister, you will turn technical breakthroughs into real-world applications that affect millions of citizens.

About the role i.

AI's Impact and Evaluation team build their work into each stage of product development, from scoping, to incubation, and onwards to scaling.

Team members embed into product development teams, designing and delivering robust evaluations at each stage of the product journey to inform their design and, ultimately, understand their impact on the quality and efficiency of public service delivery.

The team is now recruiting for two Senior AI Evaluation Engineers, to lead the evaluation of AI products.

These roles will focus on model-level evaluation, including assessment of accuracy, bias and safety.

  • What you will work on
  • Lead the design and development of evaluation pipelines and experiments across AI products
  • Architect product-wide evaluation suites that integrate with engineering and CI/CD workflows
  • Design and implement complex and exploratory evaluation methods to assess accuracy, bias, safety and overall model performance
  • Work closely with product, engineering and domain experts to shape evaluation approaches throughout the product lifecycle
  • Design and run evaluation experiments that directly inform product development and technical decisions
  • Analyse complex evaluation results and turn findings into clear recommendations for technical, product and senior stakeholders
  • Lead the communication of evaluation findings through reports, presentations and external publications
  • Support and review evaluation work from other engineers, helping to raise standards and develop evaluation capability across the team
  • Who we think will thrive in this role

You may be a strong fit if you bring some of the following

  • Broad experience of evaluating generative and predictive AI systems
  • Extensive knowledge of experimental design and statistical hypothesis testing
  • Highly proficient in Python
  • Demonstrable experience of software development tools and practices (e. g. git, CI/CD, unit testing)
  • Ability to communicate technical work to a broad audience, using different media/formats e. g. technical reports, presentations, and web-based tools.
  • Experience implementing LLM-as-a-judge and other generative AI evaluation techniques using AI evaluation tools (e. g. pydantic evals, deepeval, inspect)
  • Experience using pipeline orchestration tools e. g. DVC, snakemake
  • Knowledge of standard quantitative research designs, methods and analysis (particularly those set out in the Magenta Book)
  • Experience of mentoring junior colleagues

What we offer

  • Career-defining projects with outsized impact
  • Backing from the Prime Minister and No10 to scope and build transformative AI projects.
  • Unique opportunities to apply technology that could transform the public sector and impact citizens' lives.
  • Talented, supportive and mission-driven colleagues.
  • Resources & access
  • Access to frontier models and ample compute.
  • Extensive operational, product, strategy, design and delivery support so you can focus on shipping.
  • Work with experts across national security, policy, AI research and adjacent sciences.
  • Growth & empowerment
  • A team culture and development support that prioritises personal growth.
  • Opportunities to own important products early and develop them in small empowered teams.
  • 5 days off learning and development, annual stipends for learning and development and funding for conferences and external collaborations.
  • Life & family*
  • Opportunity to work from London, Manchester or Bristol offices.
  • Hybrid working, flexibility for occasional remote work abroad and stipends for work-from-home equipment.
  • Generous annual leave - 25 days plus one additional day for each year of service
  • Generous paid parental leave (up to 39 weeks full pay + op

Senior AI Evaluation Engineer (Data Scientist) employer: i.AI

The Incubator for AI in London is an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration among its team members. With a strong emphasis on employee growth, you will have access to cutting-edge technology and the opportunity to work on impactful public-sector projects that make a real difference. Join us to be part of a supportive environment where your contributions are valued and your career can flourish.

I

Contact Details:

i.AI Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Senior AI Evaluation Engineer (Data Scientist)

✨Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like i.AI!

✨Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Senior AI Evaluation Engineer (Data Scientist) at i.AI.

✨Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like i.AI.

✨Apply Directly through Our Website

When you find a suitable opening like Senior AI Evaluation Engineer (Data Scientist) at i.AI, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Senior AI Evaluation Engineer (Data Scientist)

Evaluation Pipeline Design
Experimental Design
Statistical Hypothesis Testing
Python Programming
Software Development Practices
CI/CD Workflows
Technical Communication

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at i.AI, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at i.AI. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at i.AI

✨Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

✨Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

✨Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at i.AI!

✨Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.