At a Glance
- Tasks: Lead the testing strategy for AI solutions in a major financial services client.
- Company: Join a dynamic consulting partner focused on innovative AI technologies.
- Benefits: Competitive day rate, hybrid working, and potential for contract extension.
- Other info: Opportunity to work with cutting-edge AI technologies and engage with senior stakeholders.
- Why this job: Shape the future of AI testing and make a real impact in a regulated environment.
- Qualifications: Proven experience in QA leadership and test strategy development.
We’re supporting a consulting partner on the search for a Lead AI Tester / QA Lead to define and own the testing strategy for several AI / LLM use cases at a major financial services client. This role is primarily about strategy, governance and delegation, with some scope to remain hands‑on.
The opportunity
- Create and maintain the test strategy and playbook for AI solutions - covering functional and non‑functional testing, regression, safety, bias, hallucinations, performance and cost.
- Translate that strategy into clear documentation and workflows (e.g. Confluence playbooks, Jira ticket structures, test plans and checklists).
- Delegate and coordinate execution across QA engineers and developers, ensuring test activities are properly defined, prioritised and completed.
- Define how AI testing fits into the CI/CD pipeline and SDLC: where tests run, what they block, and how results are surfaced.
- Establish and track evaluation metrics and monitoring for AI systems (e.g. quality, drift, safety, latency, cost), and report these to stakeholders.
- Guide and engage both internal and client stakeholders on all aspects of testing – test strategy definition, standards, metrics, monitoring and release readiness.
What we’re looking for
Must have:
- Proven experience as a Test Lead / QA Lead / SDET owning test strategy and automation in complex environments (ideally financial services or similar).
- Ability to create a test strategy document or playbook for AI solutions and keep it current.
- Experience delegating execution of a test strategy to other team members – for example via Jira ticket definition and structured test packs.
- Strong understanding of how tests and environments fit into CI/CD pipelines and wider SDLC activities.
Should have:
- Practical exposure to testing AI / ML / LLM‑based systems (e.g. chatbots, RAG applications, AI‑assisted workflows) and an interest in deepening this.
- Familiarity with approaches to evaluating LLM outputs (for example, semantic‑similarity based methods or using LLM‑as‑a‑judge), and with concepts such as hallucinations, safety, and drift.
- Experience working in consulting or client‑facing roles and presenting testing approaches and results to senior stakeholders.
Details
- Location: UK‑based, hybrid working with client and consulting teams.
- Contract: Initially 3–6 months, with strong potential to extend.
- Day rate: Up to around £600–650 per day, depending on experience.
If you’re a QA leader who wants to shape how AI and LLM solutions are tested in a regulated environment and can turn that thinking into a clear, usable playbook, please get in touch.
Lead AI Tester / QA Lead (LLM & GenAI) in Slough employer: RAW Search
Join a forward-thinking consulting partner that values innovation and excellence in the financial services sector. With a hybrid working model, you will enjoy a collaborative work culture that fosters professional growth and encourages the sharing of ideas. Our commitment to employee development and a supportive environment makes us an exceptional employer for those looking to make a meaningful impact in AI testing.
StudySmarter Expert Advice🤫
We think this is how you could land Lead AI Tester / QA Lead (LLM & GenAI) in Slough
✨Tip Number 1
Network like a pro! Reach out to your connections in the AI and QA space. Attend meetups, webinars, or even online forums. You never know who might have the inside scoop on job openings or can refer you directly to hiring managers.
✨Tip Number 2
Show off your expertise! Create a portfolio or a blog where you share insights about testing strategies, especially in AI. This not only showcases your knowledge but also makes you stand out as a thought leader in the field.
✨Tip Number 3
Prepare for interviews by diving deep into the company’s projects and challenges. Tailor your responses to demonstrate how your experience aligns with their needs, especially around testing strategies and governance in AI solutions.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Lead AI Tester / QA Lead (LLM & GenAI) in Slough
Some tips for your application 🫡
Tailor Your Application:Make sure to customise your CV and cover letter to highlight your experience with test strategies and AI solutions. We want to see how your skills align with the role, so don’t hold back on showcasing your relevant achievements!
Showcase Your Strategy Skills:Since this role is all about defining and owning the testing strategy, be sure to include examples of how you've created or maintained test strategies in the past. We love seeing concrete examples that demonstrate your strategic thinking!
Be Clear and Concise:When writing your application, clarity is key! Use straightforward language and structure your documents well. We appreciate a clean layout that makes it easy for us to see your qualifications at a glance.
Apply Through Our Website:Don’t forget to submit your application through our website! It’s the best way for us to keep track of your application and ensure it gets the attention it deserves. We can’t wait to hear from you!
How to prepare for a job interview at RAW Search
✨Know Your Testing Strategy Inside Out
Before the interview, make sure you thoroughly understand the testing strategy for AI solutions. Be ready to discuss how you would create and maintain a test playbook, covering all aspects like functional and non-functional testing. This will show your potential employer that you can hit the ground running.
✨Showcase Your Delegation Skills
Since this role involves coordinating execution across QA engineers and developers, prepare examples of how you've successfully delegated tasks in previous roles. Discuss how you defined and prioritised test activities, and be ready to explain your approach to using tools like Jira for ticket definition.
✨Familiarise Yourself with CI/CD Pipelines
Understanding how testing fits into the CI/CD pipeline is crucial. Brush up on how tests run, what they block, and how results are surfaced. Being able to articulate this clearly will demonstrate your technical expertise and readiness for the role.
✨Engage with Stakeholders Effectively
This position requires guiding both internal and client stakeholders. Prepare to discuss your experience in presenting testing approaches and results to senior stakeholders. Highlight any consulting experience you have, as well as your ability to communicate complex ideas simply and effectively.
