At a Glance
- Tasks: Join us as an AI Evaluation Engineer to enhance AI products and ensure quality.
- Company: Dynamic public sector tech team focused on innovation and collaboration.
- Benefits: Competitive daily rate, hybrid work, and opportunities for professional growth.
- Other info: Diverse and inclusive workplace with excellent career advancement potential.
- Why this job: Make a real impact in AI evaluation while working with cutting-edge technology.
- Qualifications: Experience in quality engineering and a strong grasp of AI methodologies required.
The predicted salary is between 63000 - 77000 £ per year.
- Role: AI Evaluation Engineer PSAI Tech
- Contract Length: 4 months
- Location: Hybrid/London, Bristol or Manchester - expected to attend the two days per week
- IR35: Inside
- Pay Rate to Intermediary: £700-£750 per day
- Security Clearance: BPSS and SC eligible requested
Spinwell is recruiting for an AI Evaluation Engineer PSAI Tech for an excellent opportunity within the public sector.
RESPONSIBILITIES OF THE AI EVALUATION ENGINEER PSAI TECH
- act as an AI Evaluation Engineer embedded with business and product teams to support the development and deployment of risk management toolkit.
- translate business requirements, risk-tiering frameworks and organisational risk tolerances into measurable evaluation criteria.
- design, implement and maintain AI evaluation methodologies, test suites and quality assurance processes with the downstream application teams.
- define baseline performance metrics and risk thresholds for AI products and services.
- assess model quality, reliability, robustness, safety and alignment against agreed standards for the downstream usage.
- help teams develop automated and manual evaluation pipelines to measure product performance across a range of scenarios.
- identify, investigate and communicate evaluation findings, risks and quality issues to technical and non-technical stakeholders.
- work closely with data scientists, engineers, product managers and policy teams to improve AI system performance.
- produce evaluation reports, technical documentation and recommendations to support governance and release decisions.
- contribute to the development of AI assurance, testing and quality engineering best practices across PSAI Tech.
- support audit, compliance and assurance activities relating to AI products and services.
SKILLS/EXPERIENCE OF THE AI EVALUATION ENGINEER PSAI TECH
- proven experience in quality engineering, testing or evaluation of data-driven and AI-powered products.
- strong understanding of machine learning systems, large language models (LLMs) and AI evaluation methodologies for production.
- experience defining performance metrics, KPIs, benchmarks and acceptance criteria for AI products.
- ability to translate business risks and policy requirements into measurable technical evaluation frameworks.
- experience developing automated testing and evaluation pipelines using Python or similar technologies.
- knowledge of AI safety, model robustness, bias, fairness and responsible AI principles.
- strong analytical and problem-solving skills with the ability to identify trends, risks and performance issues.
- experience working with cross-functional teams in agile product delivery environments.
- ability to communicate complex technical findings clearly to both technical and non-technical audiences.
- experience producing technical reports, dashboards and recommendations for senior stakeholders.
- familiarity with cloud-based AI platforms and modern software development practices.
- experience working in government, public sector or regulated environments is desirable.
We welcome all applications regardless of background, in line with our commitment to diversity, equality and inclusion.
Applying to this or any other vacancy advertised by Spinwell Ltd constitutes an agreement for Spinwell Ltd to hold your details for 24 months for the purpose of assessing suitability for the advertised position and to make you aware of any other positions deemed suitable of which You will make you aware by means of either email, text or phone.
In line with GDPR regulations you are able to request your details be removed from the company data at any time by emailing us
#J-18808-Ljbffr
AI Evaluation Engineer PSAI Tech - Central Government employer: Spinwell Global
Spinwell Global is an exceptional employer, offering a dynamic work environment in London that promotes a hybrid working model, allowing for flexibility and work-life balance. With a strong focus on employee development, the company provides ample opportunities for growth and training, ensuring that team leaders are well-equipped to support their caseworkers effectively. The collaborative culture fosters meaningful engagement with public sector operations, making it a rewarding place to contribute to impactful community initiatives.
StudySmarter Expert Advice🤫
We think this is how you could land AI Evaluation Engineer PSAI Tech - Central Government
✨Tap into Online Data Science Communities
Join online communities focused on data science like Kaggle, LinkedIn groups, or Reddit threads. These are goldmines for temporary gigs, as you can network with professionals and potentially hear about opportunities at companies like Spinwell Global before they're even advertised!
✨Show Off Your Skills With Projects
Got some cool data science projects? Showcase them on platforms like GitHub or create a personal portfolio website. This visibility is crucial for landing temporary roles—let recruiters see your actual skills in action, which can set you apart from the crowd.
✨Check Out Specialist Job Boards
For temp roles, hit up job boards dedicated to tech and data science, like Stack Overflow Jobs or DataJobs. These platforms often feature openings that you won’t find on general job sites, including contracts with companies like Spinwell Global.
✨Leverage University Resources
If you're currently at uni or recently graduated, tap into your school's career services. They often have connections with companies looking for temporary data science interns or contract workers, and they might even host job fairs with employers like Spinwell Global.
We think you need these skills to ace AI Evaluation Engineer PSAI Tech - Central Government
Some tips for your application 🫡
Highlight Your Data Projects:When applying for a temporary data science role at Spinwell Global, make sure to showcase any relevant projects you've worked on. Whether it's a personal project, an academic undertaking, or contributions to an open-source initiative, detailing these experiences can really set you apart and demonstrate your practical skills.
Emphasise Your Analytical Skills:In your CV and cover letter, focus on the specific analytical skills that are key to data science. Mention any experience with statistical tools, programming languages like Python or R, and data visualisation software. Don't forget to include any certifications that may bolster your expertise!
Show Your Flexibility:Since this is a temporary role, it's important to convey your adaptability and willingness to learn. In your cover letter to Spinwell Global, emphasise how quickly you can get up to speed with new tools or projects. Highlight any previous experiences where you've had to adjust to new environments or challenges.
Craft a Unique Data-Driven Cover Letter:Instead of the usual generic cover letter, spice it up with some data! Maybe you’ve improved a process by 20% in a past role or cleaned a dataset with over a million entries. Use these stats to your advantage to grab Spinwell Global’s attention and show the tangible impact of your work.
How to prepare for a job interview at Spinwell Global
✨Showcase Your Analytical Skills
For a data science gig, it's crucial to demonstrate your analytical abilities. Be ready to discuss previous projects and the methodologies you used. Think about how you can quantify your impact—did your analysis improve efficiency or save costs? These are the stories that will stick with interviewers at Spinwell Global.
✨Brush Up on Technical Skills
You might face technical questions on tools relevant to data science, like Python, R, or SQL. Prepare to solve a problem live—perhaps they'll ask you to write a simple query or code snippet. It’s cool to talk about them, but we need to show we can do it in practice, especially in a temporary role where quick results matter.
✨Highlight Your Adaptability
Since this is a temporary position, emphasise your ability to learn quickly and adapt to new tools or workflows. Share examples of how you've thrived in fast-paced environments before, and how you can hit the ground running at Spinwell Global.
✨Prepare a Portfolio of Your Work
Bring your portfolio to the table—showcase projects where you've leveraged data science techniques to solve problems. Whether it’s a GitHub repository or a set of case studies, having tangible examples of your work will help you stand out and show what you bring to the team at Spinwell Global.
