At a Glance
- Tasks: Create and evaluate AI models while collaborating with cross-functional teams.
- Company: Join a leading tech firm supporting Central Government projects.
- Benefits: Hybrid work model, competitive pay, and opportunities for professional growth.
- Other info: Exciting role with potential for career advancement in a dynamic environment.
- Why this job: Make a real impact in AI evaluation and contribute to innovative government solutions.
- Qualifications: Experience in AI evaluation, testing, and strong analytical skills required.
The predicted salary is between 63000 - 77000 £ per year.
SBA are currently supporting our Central Government client who are seeking an AI Evaluation Engineer on an initial 4 month contract.
Location: London, Bristol OR Manchester (hybrid office attendance)
Overview: The team is looking for an experienced, hands-on developer who can create their own base code, set it up and work it out.
Experience applying and working with AI model layer & agentic layer.
The ideal candidate:
- Proven experience in quality engineering, testing or evaluation of data-driven and AI-powered products.
- Strong understanding of machine learning systems, large language models (LLMs) and AI evaluation methodologies for production.
- Experience defining performance metrics, KPIs, benchmarks and acceptance criteria for AI products.
- Ability to translate business risks and policy requirements into measurable technical evaluation frameworks.
- Experience developing automated testing and evaluation pipelines using Python or similar technologies.
- Knowledge of AI safety, model robustness, bias, fairness and responsible AI principles.
- Strong analytical and problem-solving skills with the ability to identify trends, risks and performance issues.
- Experience working with cross-functional teams in agile product delivery environments.
- Ability to communicate complex technical findings clearly to both technical and non-technical audiences.
- Experience producing technical reports, dashboards and recommendations for senior stakeholders.
- Familiarity with cloud-based AI platforms and modern software development practices.
- Experience working in government, public sector or regulated environments is desirable.
NB: The successful candidate may need to undergo SC while in post, so must be eligible/willing to attain. However, the successful candidate can start on BPSS.
To apply, please submit latest CV.
AI Evaluation Engineer employer: SUMMER-BROWNING ASSOCIATES LIMITED
SBA is an exceptional employer, offering a dynamic work environment that fosters collaboration and innovation. With a strong commitment to employee development, we provide ample opportunities for growth and advancement within the Central Government sector. Our inclusive culture and focus on meaningful projects ensure that every team member feels valued and empowered to make a difference.
Contact Details:
SUMMER-BROWNING ASSOCIATES LIMITED Recruitment Team
