Lead AI Tester / QA Lead (LLM & GenAI) in City of London
Lead AI Tester / QA Lead (LLM & GenAI)

Lead AI Tester / QA Lead (LLM & GenAI) in City of London

City of London Freelance 60000 - 65000 £ / year (est.) Home office (partial)
RAW Search

At a Glance

  • Tasks: Lead the testing strategy for AI solutions in a major financial services client.
  • Company: Join a dynamic consulting partner focused on innovative AI technologies.
  • Benefits: Competitive day rate, hybrid working, and opportunities to shape AI testing.
  • Other info: Collaborate with diverse teams and engage with senior stakeholders.
  • Why this job: Make a real impact on AI testing strategies in a regulated environment.
  • Qualifications: Proven experience in QA leadership and testing AI/ML systems.

The predicted salary is between 60000 - 65000 £ per year.

We’re supporting a consulting partner on the search for a Lead AI Tester / QA Lead to define and own the testing strategy for several AI / LLM use cases at a major financial services client. This role is primarily about strategy, governance and delegation, with some scope to remain hands‑on.

Create and maintain the test strategy and playbook for AI solutions - covering functional and non‑functional testing, regression, safety, bias, hallucinations, performance and cost.

Delegate and coordinate execution across QA engineers and developers, ensuring test activities are properly defined, prioritised and completed.

Define how AI testing fits into the CI/CD pipeline and SDLC: where tests run, what they block, and how results are surfaced.

Establish and track evaluation metrics and monitoring for AI systems (e.g. quality, drift, safety, latency, cost), and report these to stakeholders.

Guide and engage both internal and client stakeholders on all aspects of testing – test strategy definition, standards, metrics, monitoring and release readiness.

Proven experience as a Test Lead / QA Lead / SDET owning test strategy and automation in complex environments (ideally financial services or similar).

Ability to create a test strategy document or playbook for AI solutions and keep it current.

Practical exposure to testing AI / ML / LLM‑based systems (e.g. chatbots, RAG applications, AI‑assisted workflows) and an interest in deepening this.

Experience working in consulting or client‑facing roles and presenting testing approaches and results to senior stakeholders.

Location: UK‑based, hybrid working with client and consulting teams.

Contract: Day rate: Up to around £600–650 per day, depending on experience.

If you’re a QA leader who wants to shape how AI and LLM solutions are tested in a regulated environment and can turn that thinking into a clear, usable playbook, please get in touch.

Lead AI Tester / QA Lead (LLM & GenAI) in City of London employer: RAW Search

As a Lead AI Tester / QA Lead at our consulting partner, you will thrive in a dynamic and innovative environment that prioritises employee growth and collaboration. With a strong focus on strategy and governance, you'll have the opportunity to shape testing practices for cutting-edge AI solutions while enjoying a hybrid working model that promotes work-life balance. Our culture encourages continuous learning and engagement with both internal teams and clients, making it an ideal place for professionals eager to make a meaningful impact in the financial services sector.
RAW Search

Contact Detail:

RAW Search Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Lead AI Tester / QA Lead (LLM & GenAI) in City of London

✨Tip Number 1

Network like a pro! Reach out to your connections in the AI and QA space. Attend meetups, webinars, or even local events. You never know who might have the inside scoop on job openings or can refer you directly to hiring managers.

✨Tip Number 2

Showcase your expertise! Create a portfolio that highlights your previous testing strategies and playbooks. Use real examples from your experience, especially in financial services, to demonstrate how you’ve tackled complex challenges.

✨Tip Number 3

Prepare for interviews by brushing up on your knowledge of AI testing frameworks and methodologies. Be ready to discuss how you would define and implement a testing strategy for AI solutions, as this will be key in impressing potential employers.

✨Tip Number 4

Don’t forget to apply through our website! We’re always looking for talented individuals like you. Plus, applying directly can sometimes give you an edge over other candidates. So, get your application in and let’s shape the future of AI testing together!

We think you need these skills to ace Lead AI Tester / QA Lead (LLM & GenAI) in City of London

Test Strategy Development
Governance and Delegation
Functional Testing
Non-Functional Testing
Regression Testing
Safety Testing
Bias Testing
Performance Testing
Cost Analysis
CI/CD Pipeline Integration
SDLC Knowledge
Evaluation Metrics Establishment
Stakeholder Engagement
AI/ML/LLM Testing Experience
Consulting Experience

Some tips for your application 🫡

Tailor Your CV: Make sure your CV speaks directly to the job description. Highlight your experience in defining test strategies and working with AI solutions. We want to see how your skills align with what we're looking for!

Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for the Lead AI Tester role. Share specific examples of your past experiences that relate to the responsibilities outlined in the job description.

Showcase Your Technical Skills: Don’t forget to mention your hands-on experience with testing AI/ML systems. We’re keen on seeing how you’ve tackled challenges in complex environments, especially in financial services. Be specific about the tools and methodologies you've used!

Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any important updates from us!

How to prepare for a job interview at RAW Search

✨Know Your Testing Strategies

Make sure you’re well-versed in various testing strategies, especially for AI and LLM systems. Be ready to discuss how you would create and maintain a test strategy and playbook, covering everything from functional to non-functional testing.

✨Showcase Your Leadership Skills

As a Lead AI Tester, you'll need to demonstrate your ability to delegate and coordinate effectively. Prepare examples of how you've successfully led teams in the past, particularly in complex environments like financial services.

✨Understand the CI/CD Pipeline

Familiarise yourself with how AI testing fits into the CI/CD pipeline and SDLC. Be prepared to explain where tests run, what they block, and how results are surfaced, as this will be crucial in your role.

✨Engage with Stakeholders

Since this role involves guiding both internal and client stakeholders, practice articulating your testing approaches and results clearly. Think of ways to present complex information in an understandable manner, as this will impress during your interview.

Lead AI Tester / QA Lead (LLM & GenAI) in City of London
RAW Search
Location: City of London

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>