At a Glance
- Tasks: Evaluate and enhance AI models while developing automated testing pipelines.
- Company: Join a leading tech firm supporting Central Government projects.
- Benefits: Hybrid work model, competitive pay, and opportunities for professional growth.
- Other info: Work in a dynamic environment with potential for career advancement.
- Why this job: Make a real impact in AI evaluation and contribute to innovative government solutions.
- Qualifications: Experience in AI evaluation, testing, and strong analytical skills required.
The predicted salary is between 63000 - 77000 £ per year.
SBA are currently supporting our Central Government client who are seeking an AI Evaluation Engineer on an initial 4 month contract.
Location: London, Bristol OR Manchester (hybrid office attendance)
Overview: The team is looking for an experienced, hands-on developer who can create their own base code, set it up and work it out. Experience applying and working with AI model layer & agentic layer.
The ideal candidate:
- Proven experience in quality engineering, testing or evaluation of data-driven and AI-powered products.
- Strong understanding of machine learning systems, large language models (LLMs) and AI evaluation methodologies for production.
- Experience defining performance metrics, KPIs, benchmarks and acceptance criteria for AI products.
- Ability to translate business risks and policy requirements into measurable technical evaluation frameworks.
- Experience developing automated testing and evaluation pipelines using Python or similar technologies.
- Knowledge of AI safety, model robustness, bias, fairness and responsible AI principles.
- Strong analytical and problem-solving skills with the ability to identify trends, risks and performance issues.
- Experience working with cross-functional teams in agile product delivery environments.
- Ability to communicate complex technical findings clearly to both technical and non-technical audiences.
- Experience producing technical reports, dashboards and recommendations for senior stakeholders.
- Familiarity with cloud-based AI platforms and modern software development practices.
- Experience working in government, public sector or regulated environments is desirable.
NB: The successful candidate may need to undergo SC while in post, so must be eligible/willing to attain. However, the successful candidate can start on BPSST.
To apply, please submit latest CV.
AI Evaluation Engineer in Bexley employer: All The Top Bananas
My Four Wheels is an exceptional employer, offering a rewarding career as a Trainee Driving Instructor with flexible working hours and the potential to earn up to £50,000+ annually. With comprehensive training provided through our new Training Academy, employees benefit from ongoing support and resources, ensuring a fulfilling journey towards becoming a qualified instructor while enjoying the satisfaction of teaching locally in Westfield, Surrey.
