Senior AI Evaluation Engineer (Data Scientist) New London, Bristol, Manchester

Senior AI Evaluation Engineer (Data Scientist) New London, Bristol, Manchester

London Freelance 63000 - 77000 £ / year (est.) Hybrid
AI

At a Glance

  • Tasks: Lead the evaluation of AI products, focusing on accuracy, bias, and safety.
  • Company: Join a pioneering team in government AI innovation.
  • Benefits: Competitive salary, generous leave, remote work options, and professional development support.
  • Other info: Collaborative culture with opportunities for personal growth and career-defining projects.
  • Why this job: Make a real impact on public services using cutting-edge AI technology.
  • Qualifications: Experience in evaluating AI systems and proficiency in Python required.

The predicted salary is between 63000 - 77000 £ per year.

Applications for this position close on 3rd November 2026 – 23.45pm UK Time.

Help shape how people interact with some of the most ambitious AI products in government.

The Incubator for AI (i.AI) is a team of ~80 builders and operators using frontier AI to improve public services across healthcare, education, planning and parliament. We combine startup pace and autonomy with the opportunity to tackle national-scale challenges.

We operate under three core principles:

  • Talent: We bring together the UK’s best AI talent across a range of functions. You will work alongside exceptional researchers and top government leaders, staying at the cutting edge of technology.
  • Innovation: We set precedents for what is possible in government. We combine the pace of a start-up with the influence of being at the digital centre of government. You will test new ideas, expand what is possible, and leverage unique government data to create novel solutions.
  • Impact: We are dedicated to using AI as a tool for public good - this can mean improving outcomes in schools, boosting housebuilding or providing more personalised support for those in need. With the backing of the Prime Minister, you will turn technical breakthroughs into real-world applications that affect millions of citizens.

About the role:

i.AI’s Impact and Evaluation team build their work into each stage of product development, from scoping, to incubation, and onwards to scaling. Team members embed into product development teams, designing and delivering robust evaluations at each stage of the product journey to inform their design and, ultimately, understand their impact on the quality and efficiency of public service delivery.

The team is now recruiting for two Senior AI Evaluation Engineers, to lead the evaluation of AI products. These roles will focus on model-level evaluation, including assessment of accuracy, bias and safety.

What you will work on:

  • Lead the design and development of evaluation pipelines and experiments across AI products.
  • Architect product-wide evaluation suites that integrate with engineering and CI/CD workflows.
  • Design and implement complex and exploratory evaluation methods to assess accuracy, bias, safety and overall model performance.
  • Work closely with product, engineering and domain experts to shape evaluation approaches throughout the product lifecycle.
  • Design and run evaluation experiments that directly inform product development and technical decisions.
  • Analyse complex evaluation results and turn findings into clear recommendations for technical, product and senior stakeholders.
  • Lead the communication of evaluation findings through reports, presentations and external publications.
  • Support and review evaluation work from other engineers, helping to raise standards and develop evaluation capability across the team.

Who we think will thrive in this role:

You may be a strong fit if you bring some of the following:

  • Broad experience of evaluating generative and predictive AI systems.
  • Extensive knowledge of experimental design and statistical hypothesis testing.
  • Highly proficient in Python.
  • Demonstrable experience of software development tools and practices (e.g. git, CI/CD, unit testing).
  • Ability to communicate technical work to a broad audience, using different media/formats e.g. technical reports, presentations, and web-based tools.
  • Experience implementing LLM-as-a-judge and other generative AI evaluation techniques using AI evaluation tools (e.g. pydantic evals, deepeval, inspect).
  • Experience using pipeline orchestration tools e.g. DVC, snakemake.
  • Knowledge of standard quantitative research designs, methods and analysis (particularly those set out in the Magenta Book).
  • Experience of mentoring junior colleagues.

What we offer:

  • Career-defining projects with outsized impact.
  • Backing from the Prime Minister and No10 to scope and build transformative AI projects.
  • Unique opportunities to apply technology that could transform the public sector and impact citizens’ lives.
  • Talented, supportive and mission-driven colleagues.

Resources & access:

  • Access to frontier models and ample compute.
  • Extensive operational, product, strategy, design and delivery support so you can focus on shipping.
  • Work with experts across national security, policy, AI research and adjacent sciences.
  • A team culture and development support that prioritises personal growth.
  • Opportunities to own important products early and develop them in small empowered teams.
  • 5 days off learning and development, annual stipends for learning and development and funding for conferences and external collaborations.

Life & family:

  • Opportunity to work from London, Manchester or Bristol offices.
  • Hybrid working, flexibility for occasional remote work abroad and stipends for work-from-home equipment.
  • Generous annual leave - 25 days plus one additional day for each year of service.
  • Generous paid parental leave (up to 39 weeks full pay + option for additional unpaid time).
  • On top of your salary, we contribute 28.97% of your base salary to your pension.
  • Discounts and benefits for cycling to work, dental insurance, donations and retail/gyms.

Salary - G7:

Salary is paid within the range shown below. As this is a GDaD role, the maximum salary includes a non-pensionable technical allowance, and successful candidates will be appointed somewhere within that range depending on assessment of skills demonstrated during the interview process. Base salary for candidates joining from outside the civil service be the minimum of the pay band.

National: £58,275 - £81,885 (maximum includes non-pensionable technical allowance of up to £15,600)

London: £63,165 - £86,640 (maximum includes non-pensionable technical allowance of up to £15,600)

Appointment is conditional on successfully completing UK Government SC clearance. Prior clearance is not required—we will sponsor and support you. You should normally have been resident in the UK for 2 of the past 5 years. Employment is conditional on obtaining and maintaining the required clearance(s).

In accordance with the Civil Service Commission rules, the following list contains all elements of the selection process. Candidates should expect to go through some or all of the following stages once an application has been submitted:

  • Preliminary call - a short initial conversation with members of the team you’d be joining.
  • Technical interview - a live online technical assessment.
  • Behavioural interview - focused on your previous experience and how you approach different workplace situations.
  • Senior leadership conversation - a final discussion with members of the senior leadership team.

Senior AI Evaluation Engineer (Data Scientist) New London, Bristol, Manchester employer: AI

Join a forward-thinking AI company that values innovation and collaboration, offering a dynamic work culture where your language skills in French, Dutch, or German will be highly valued. With competitive salaries and opportunities for professional growth, you will thrive in an environment that encourages creativity and teamwork while making a meaningful impact across Europe.

AI

Contact Details:

AI Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Senior AI Evaluation Engineer (Data Scientist) New London, Bristol, Manchester

✨Showcase Your Skills with a Public Portfolio

As a freelancer in data science, having a killer portfolio is essential. Showcase your projects on platforms like GitHub or create a personal website that details your work and techniques. This gives potential clients a clear picture of what you can do and helps you stand out from the competition.

✨Get Involved in Data Science Communities

Tap into online forums like Kaggle or Stack Overflow. Not only can you showcase your expertise, but you can also connect with other data scientists and potential clients. Plus, participating in competitions and discussions can elevate your profile in the field.

✨Leverage Local Networking Opportunities

Keep an eye out for local data science meetups or tech events in your area. These are golden opportunities to meet potential clients and collaborators face-to-face. Plus, who doesn't love a bit of networking over pizza and drinks?

✨Pitch Your Services Directly to Companies

Don't just wait for freelancing platforms to bring clients to you—be proactive! Research companies that could benefit from data science services and craft tailored pitches. Mention specific pain points you can address for them. Let’s get that freelance hustle going!

We think you need these skills to ace Senior AI Evaluation Engineer (Data Scientist) New London, Bristol, Manchester

Evaluation Pipeline Design
Experimental Design
Statistical Hypothesis Testing
Python Programming
Software Development Practices
CI/CD Workflows
Technical Communication

Some tips for your application 🫡

Showcase Your Projects:When applying for a freelance data science role like Senior AI Evaluation Engineer (Data Scientist) New London, Bristol, Manchester at AI, it’s crucial to highlight your projects. Include a portfolio that features at least two or three projects involving data analysis, machine learning, or visualisation. Make sure to describe the tools and methodologies you used, so we can see your skills in action!

Quantify Your Achievements:Freelance gigs, especially in data science, often ask for proven results. In your CV, include any relevant metrics or outcomes from your previous work. Did your analysis help reduce costs by a certain percentage? Or did your predictive model improve performance? Numbers speak volumes!

Introduce Your Style:Since freelancing is all about your individual style and approach, use your cover letter to share how you tackle data problems. This is your chance to let us know how you think, your creative problem-solving methods, and how you would approach a project at AI.

Be Real About Your Rates:When you send in your application, don’t forget to mention your freelance rates and availability. We appreciate clarity up front, and it helps us gauge if you fit within our budget and timeline. Being transparent in this aspect shows professionalism and readiness!

How to prepare for a job interview at AI

✨Show Off Your Data Wizardry

As a freelancer in data science, you'll want to present a portfolio that showcases your best projects. We should pull together examples where you tackled real problems with data analytics, machine learning models, or visualisations. It's all about demonstrating your skills in action!

✨Be Ready to Dive Deep into Technical Questions

Expect to encounter some technical grilling during the interview. Prepare to discuss statistical methods, algorithms, or maybe even tackle a live coding challenge. We should brush up on tools like Python, R, or SQL—those are key players in the data science field. Don't just know them; be ready to explain your thought process!

✨Help Them Understand Your Work Style

Freelance gigs often mean you'll be working independently, so we need to convey our self-motivation and time management skills. Be prepared to talk about how you’ve handled multiple projects or met tight deadlines before. Sharing your approach to client communication can also give them confidence in your ability to deliver remotely.

✨Pitch Your Value Proposition

When freelancing, it’s crucial to clearly articulate what makes you unique. We should highlight not just technical skills but also the business impact of our projects. Think of a couple of stories where your data insights drove decision-making—this can be a game changer in showing why they should choose you for their freelance needs!