Newcastle, United Kingdom | Posted on 16/10/2026 Scrumconnect Consulting is a multi-award-winning UK public sector digital consultancy, positively influencing the lives of over forty million UK citizens. We bring deep expertise in agile delivery, digital transformation, and platform engineering across central government. With a team of over one hundred and twenty-five professionals — more than forty percent of whom are women — we are committed to building inclusive, diverse teams that reflect the communities we serve. Overview We are seeking an experienced Senior Quality Assurance Tester to lead testing strategy and execution for a Generative AI platform for a UK government department. This role goes beyond traditional functional QA. It includes evaluating AI output quality (answer accuracy, retrieval relevance, hallucination rate) alongside conventional API, integration and non-functional testing. Key Responsibilities Define and own the test strategy across functional, non-functional and AI-specific quality dimensions (answer quality, retrieval accuracy, hallucination rate), covering RAG pipelines, prompt templates and Agentic workflows. AI Output Evaluation Design and run structured evaluations of LLM outputs, working with engineering to track answer quality and hallucination rate over time, and flag regressions before release. API
Senior QAT (Quality Assurance Tester) employer: Scrumconnect Limited
Scrumconnect Consulting is an exceptional employer that fosters a collaborative and innovative work culture in the heart of London. With a strong emphasis on professional growth, employees are encouraged to enhance their skills through continuous learning and participation in Agile practices. The company offers competitive benefits and a dynamic environment where your contributions directly impact cutting-edge AI-driven services.
