Senior/Research Associate, AI Evaluation and Assurance

The Research Associate will lead a scoped research project on the combination of evaluation evidence and explanation methods about machine-learning systems. The post holder will draw on evidence theory, probabilistic reasoning and current work on machine reasoning and human interpretation, and illustrate it on results from the theme's evaluation platform. Alongside the theoretical work, the role contributes to evaluation studies and assurance frameworks in defence and civil aviation, while helping shape a longer-term research programme exploring AI evaluation, verification and uncertainty across emerging technologies such as language models and agentic systems.

This role will also collaborate with a research software engineering team that builds and runs the theme's evaluation infrastructure. Internally they will be expected to collaborate with colleagues across Fundamental Research and other missions (e.g. Defence and National Security). Externally, the main stakeholders are, initially, the industry partner and, through it, government stakeholders in defence and national security.

About you

You’ll be a technically strong and curious researcher with expertise in Machine Learning evaluation, designing, uncertainty or assurance, and a passion for understanding how we can build credible evidence that AI systems can be trusted. You’ll combine demonstrable technical skills with hands‑on experience designing and analysing machine-learning evaluations, using Python, statistical methods and reproducible research practices to turn complex results into meaningful insights.

The successful candidate will be comfortable working across disciplines, able to communicate technical ideas clearly to researchers, engineers and external stakeholders, including those operating in defence and other regulated environments. At Senior Research Associate level, you’ll also bring the confidence to lead research independently, shape research direction, influence partners and mentor others, helping drive forward longer‑term work in AI evaluation, verification and assurance.

How you will make an impact

• Communicate and present research outputs to diverse stakeholders, including project partners, through conferences, events, sprint reviews, workshops, meetings and press opportunities as appropriate.
• Adhere to and promote principles of reproducible and ethical data science and ensure secure handling of data and health and safety in all aspects of work.
• Lead the research and writing of a peer‑reviewed paper setting out a formal account of how evaluation and explanation evidence about machine‑learning systems can be combined, illustrated with results from the theme's evaluation platform.
• Design and analyse evaluation studies of machine‑learning components, including choice of metrics, experimental protocols and statistical analysis, for explanation methods and for systems operating under latency and hardware constraints, working with research software engineers who implement and run them.
• Map evaluation evidence onto assurance and certification frameworks and onto structured assurance arguments.
• Design protocols for eliciting requirements from domain experts and operators, and complete the ethics applications and data protection assessments needed to run them.
• Draft specifications and handling plans for datasets curated with partners, and contribute to the design of the theme's evaluation platform.

Additional duties for senior level

• Provide intellectual and technical leadership for the research project, defining and refining the research direction with the Principal Investigator and wider team.
• Lead engagement with project partners and stakeholders on research priorities, assurance requirements and the interpretation of evaluation evidence, deputising for the Principal Investigator where appropriate.
• Lead the preparation of proposals, applications and reports for follow‑on funding and partnership activity.
• Coordinate research delivery across relevant researchers and research software engineers, identifying dependencies, risks and decisions required to achieve successful outcomes.

Please see our portal for a full breakdown of the role.

Closing date for applications

Sunday 29 November at 23:59 (London, UK BST/GMT)

Terms and Conditions

This full‑time post is offered, on a permanent basis. The annual salary range is £46,415 - £52,494 for Research Associate level / £57,000 - £59,000 for Senior Research Associate level. Our offers include excellent benefits, including flexible working and family friendly policies, which can be seen here.

Eligibility for Security Check (SC) clearance is a requirement for this role

Eligibility criteria and further information on the process can be found on the UK Government security vetting website.

We offer a flexible, hybrid approach to working, recognising the benefits of both remote working and in‑person collaboration. Office attendance expectations may vary depending on the role, team and organisational needs, and may evolve over time. The hiring team will be happy to discuss the current arrangements during the interview process.

Equality, Diversity and Inclusion

The Alan Turing Institute is committed to creating an environment where diversity is valued and everyone is treated fairly. We value diversity of background, experience, and perspective, and are proud to be an inclusive employer. We warmly encourage applications from all backgrounds, particularly from groups currently under‑represented in our sector. If you feel passionate about this role but don’t meet every single requirement, please apply - we recognise that great candidates may bring strengths beyond the criteria listed.

#J-18808-Ljbffr