At a Glance
- Tasks: Lead AI evaluation frameworks and ensure quality in GenAI outputs.
- Company: Join the FCA, a key regulator in the UK financial services sector.
- Benefits: Flexible working, competitive salary, and opportunities for professional growth.
- Other info: Collaborative environment with a focus on innovation and public interest.
- Why this job: Make a real impact on financial services while protecting millions of consumers.
- Qualifications: Experience in AI evaluation and strong analytical skills required.
The predicted salary is between 55000 - 65000 € per year.
Overview
The Financial Conduct Authority (FCA) regulates financial services firms and financial markets in the UK. The Data, Technology and Innovation (DTI) division enables the FCA to be a digital-first, data-led smart regulator by delivering a secure, agile, and cost-effective technology and data ecosystem that drives better decisions, transparency, and operational efficiency.
Working alongside the wider AI Programme, the department will partner with business leads to shape and deliver work in priority areas — Authorisations, SPC, EMO and Anti‑Money Laundering.
Role Responsibilities
- Define and own evaluation frameworks for GenAI outputs covering quality measures such as accuracy, relevance, robustness and hallucination rates.
- Design, curate and govern test datasets and benchmarks to ensure consistent model and solution performance assessment over time.
- Support development of automated evaluation pipelines and operational reporting to embed assurance into delivery.
- Identify, assess and mitigate risks in model behaviour (e.g., bias, errors, safety concerns, edge cases) with clear escalation and control recommendations.
- Manage delivery through well-defined work packages, setting priorities, operating standards and performance objectives including line management of Business Analysts.
- Engage senior stakeholders to understand strategic priorities, build a pipeline of scoped and prioritised projects, and translate needs into analytics-led solutions with clear business value.
- Work in the public interest protecting 40 million UK consumers who rely on financial services and supporting long-term economic growth from an industry contributing 12% of UK economic output.
- Manage digital and data-led change by encouraging innovative experiments and working with senior stakeholders while empowering a diverse team to collaborate openly.
Location: London, Edinburgh, Leeds
Contract type: Full time, Permanent
Profession: AI, Data, Financial Services
Working pattern: Flexible working, Hybrid
Closing Date: 20/05/2026
AI Evaluation Lead in Leeds employer: UK Regulators' Network
The Financial Conduct Authority (FCA) is an exceptional employer, offering a dynamic work environment that prioritises innovation and collaboration in the heart of the UK's financial sector. With a strong commitment to employee growth, the FCA provides ample opportunities for professional development while fostering a culture of inclusivity and transparency. Working in locations like London, Edinburgh, and Leeds, employees benefit from flexible working arrangements and the chance to make a meaningful impact on the lives of 40 million UK consumers.
StudySmarter Expert Advice🤫
We think this is how you could land AI Evaluation Lead in Leeds
✨Tip Number 1
Network like a pro! Reach out to people in the industry, especially those at the FCA or similar organisations. A friendly chat can open doors and give you insights that might just set you apart from the competition.
✨Tip Number 2
Prepare for interviews by diving deep into the role's responsibilities. Understand the evaluation frameworks and risk management strategies mentioned in the job description. This way, you can showcase your knowledge and passion for the position.
✨Tip Number 3
Don’t forget to follow up after interviews! A quick thank-you email can leave a lasting impression. Mention something specific from your conversation to show you were engaged and are genuinely interested in the role.
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets seen. Plus, we love seeing candidates who take the initiative to engage directly with us. Let’s make it happen!
We think you need these skills to ace AI Evaluation Lead in Leeds
Some tips for your application 🫡
Tailor Your Application:Make sure to customise your CV and cover letter for the AI Evaluation Lead role. Highlight your experience with evaluation frameworks and data analysis, as these are key to what we’re looking for at StudySmarter.
Showcase Relevant Skills:Don’t forget to emphasise your skills in managing risks and delivering projects. We want to see how you can contribute to our mission of being a digital-first, data-led regulator, so make those skills pop!
Be Clear and Concise:When writing your application, keep it straightforward. Use clear language and get straight to the point. We appreciate brevity and clarity, especially when it comes to complex topics like AI and data.
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way to ensure your application gets into the right hands and shows us you’re serious about joining the StudySmarter team!
How to prepare for a job interview at UK Regulators' Network
✨Know Your AI Stuff
Make sure you brush up on the latest trends and technologies in AI, especially around evaluation frameworks. Be ready to discuss how you would define quality measures like accuracy and robustness in GenAI outputs.
✨Showcase Your Problem-Solving Skills
Prepare examples of how you've identified and mitigated risks in model behaviour before. Think about specific instances where you tackled bias or errors, and be ready to explain your thought process.
✨Engage with Stakeholders
Since the role involves working with senior stakeholders, practice how you would communicate complex ideas clearly. Have a few examples ready that demonstrate your ability to translate technical needs into business value.
✨Demonstrate Leadership and Collaboration
Be prepared to talk about your experience managing teams and projects. Highlight how you've empowered diverse teams to innovate and collaborate, as this will resonate well with the FCA's focus on digital and data-led change.
