At a Glance
- Tasks: Lead the testing strategy for AI solutions in a major financial services client.
- Company: Join a dynamic consulting partner focused on innovative AI technologies.
- Benefits: Competitive day rate, hybrid working, and opportunities to shape AI testing.
- Other info: Collaborate with diverse teams and engage with senior stakeholders.
- Why this job: Make a real impact on AI testing strategies in a regulated environment.
- Qualifications: Proven experience in QA leadership and testing AI/ML systems.
The predicted salary is between 60000 - 65000 £ per year.
We’re supporting a consulting partner on the search for a Lead AI Tester / QA Lead to define and own the testing strategy for several AI / LLM use cases at a major financial services client. This role is primarily about strategy, governance and delegation, with some scope to remain hands‑on.
Create and maintain the test strategy and playbook for AI solutions - covering functional and non‑functional testing, regression, safety, bias, hallucinations, performance and cost.
Delegate and coordinate execution across QA engineers and developers, ensuring test activities are properly defined, prioritised and completed.
Define how AI testing fits into the CI/CD pipeline and SDLC: where tests run, what they block, and how results are surfaced.
Establish and track evaluation metrics and monitoring for AI systems (e.g. quality, drift, safety, latency, cost), and report these to stakeholders.
Guide and engage both internal and client stakeholders on all aspects of testing – test strategy definition, standards, metrics, monitoring and release readiness.
Proven experience as a Test Lead / QA Lead / SDET owning test strategy and automation in complex environments (ideally financial services or similar).
Ability to create a test strategy document or playbook for AI solutions and keep it current.
Practical exposure to testing AI / ML / LLM‑based systems (e.g. chatbots, RAG applications, AI‑assisted workflows) and an interest in deepening this.
Experience working in consulting or client‑facing roles and presenting testing approaches and results to senior stakeholders.
Location: UK‑based, hybrid working with client and consulting teams.
Contract: Day rate: Up to around £600–650 per day, depending on experience.
If you’re a QA leader who wants to shape how AI and LLM solutions are tested in a regulated environment and can turn that thinking into a clear, usable playbook, please get in touch.
Lead AI Tester / QA Lead (LLM & GenAI) in City of London employer: RAW Search
Contact Detail:
RAW Search Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead AI Tester / QA Lead (LLM & GenAI) in City of London
✨Tip Number 1
Network like a pro! Reach out to your connections in the AI and QA space. Attend meetups, webinars, or even local events. You never know who might have the inside scoop on job openings or can refer you directly to hiring managers.
✨Tip Number 2
Showcase your expertise! Create a portfolio that highlights your previous testing strategies and playbooks. Use real examples from your experience, especially in financial services, to demonstrate how you’ve tackled complex challenges.
✨Tip Number 3
Prepare for interviews by brushing up on your knowledge of AI testing frameworks and methodologies. Be ready to discuss how you would define and implement a testing strategy for AI solutions, as this will be key in impressing potential employers.
✨Tip Number 4
Don’t forget to apply through our website! We’re always looking for talented individuals like you. Plus, applying directly can sometimes give you an edge over other candidates. So, get your application in and let’s shape the future of AI testing together!
We think you need these skills to ace Lead AI Tester / QA Lead (LLM & GenAI) in City of London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV speaks directly to the job description. Highlight your experience in defining test strategies and working with AI solutions. We want to see how your skills align with what we're looking for!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for the Lead AI Tester role. Share specific examples of your past experiences that relate to the responsibilities outlined in the job description.
Showcase Your Technical Skills: Don’t forget to mention your hands-on experience with testing AI/ML systems. We’re keen on seeing how you’ve tackled challenges in complex environments, especially in financial services. Be specific about the tools and methodologies you've used!
Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any important updates from us!
How to prepare for a job interview at RAW Search
✨Know Your Testing Strategies
Make sure you’re well-versed in various testing strategies, especially for AI and LLM systems. Be ready to discuss how you would create and maintain a test strategy and playbook, covering everything from functional to non-functional testing.
✨Showcase Your Leadership Skills
As a Lead AI Tester, you'll need to demonstrate your ability to delegate and coordinate effectively. Prepare examples of how you've successfully led teams in the past, particularly in complex environments like financial services.
✨Understand the CI/CD Pipeline
Familiarise yourself with how AI testing fits into the CI/CD pipeline and SDLC. Be prepared to explain where tests run, what they block, and how results are surfaced, as this will be crucial in your role.
✨Engage with Stakeholders
Since this role involves guiding both internal and client stakeholders, practice articulating your testing approaches and results clearly. Think of ways to present complex information in an understandable manner, as this will impress during your interview.