AI Test Engineer

AI Test Engineer

Full-Time 50000 - 70000 £ / year (est.) No working from home possible
CluePoints

At a Glance

  • Tasks: Test AI-powered features and ensure their reliability and accuracy in real-world scenarios.
  • Company: Join CluePoints, a fast-growing tech scale-up transforming clinical trials with AI.
  • Benefits: Enjoy a dynamic culture, flexible work environment, and opportunities for continuous learning.
  • Other info: Be part of a diverse team united by a mission to improve human outcomes.
  • Why this job: Make a real impact on healthcare by validating innovative AI technologies.
  • Qualifications: Experience in testing AI systems and strong skills in Playwright and JavaScript.

The predicted salary is between 50000 - 70000 £ per year.

At CluePoints, we’re redefining how clinical trials are run. As the premier provider of Risk-Based Quality Management (RBQM) and Data Quality Oversight software, we harness advanced statistics, artificial intelligence, and machine learning to ensure the quality, accuracy, and integrity of clinical trial data, helping life sciences organizations bring safer, more effective treatments to patients faster.

We’re proud to be an ambitious, fast-growing technology scale-up with a dynamic and diverse international team representing more than 20 nationalities. Collaboration, flexibility, and continuous learning are part of our DNA. At CluePoints, you’ll find a culture where you can grow, make an impact, and have fun along the way. Guided by our values of Care, Passion, and Smart Disruption, we’re united by a shared mission: to create smarter ways to run efficient clinical trials and deliver AI-powered insights that improve human outcomes worldwide.

We are looking for a highly skilled AI Tester with strong Playwright expertise who embraces an AI-First approach to quality engineering. In this role, your primary focus will be testing AI-powered features implemented within the application; ensuring their reliability, accuracy, robustness, explainability, and compliance with product expectations. While automation remains a critical capability, this role requires a strong understanding of how AI-driven functionality behaves in real-world scenarios, including edge cases, model variability, and prompt-driven outputs. You will play a key role in validating AI features end-to-end — from requirement analysis and test design to automated validation, exploratory testing, and model behavior analysis, while continuing to leverage AI tools like GitHub Copilot/Codex to accelerate test development.

Requirements

  • Experience testing AI-driven or data-driven systems (LLMs, ML models, rule engines, recommendation systems, NLP-based features, etc.).
  • Understanding of AI/ML behaviour concepts such as prompt variability, non-deterministic outputs, confidence thresholds, bias, hallucinations, and edge-case handling.
  • Ability to design validation strategies for probabilistic systems where results may not always be binary (pass/fail).
  • Strong hands-on experience with Playwright automation framework.
  • Proficiency in JavaScript or TypeScript.
  • Demonstrated expertise using GitHub Copilot, Codex, or AI coding assistants as part of daily development workflow.
  • Solid understanding of automation framework architecture and design patterns.
  • (nice to have) Regulatory experience in the pharmaceuticals (clinical trials), Insurance / Banking / Fintech (advantageous).

AI Test Engineer employer: CluePoints

At CluePoints, we pride ourselves on being an innovative technology scale-up that fosters a vibrant and inclusive work environment. Our commitment to collaboration and continuous learning ensures that as an AI Test Engineer, you will have ample opportunities for professional growth while contributing to meaningful projects that enhance clinical trial processes. With a diverse team representing over 20 nationalities, you'll enjoy a dynamic culture where your contributions are valued, and your passion for technology can truly make a difference.

CluePoints

Contact Details:

CluePoints Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land AI Test Engineer

Tip Number 1

Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.

Tip Number 2

Show off your skills! Create a portfolio or GitHub repository showcasing your AI testing projects. This gives potential employers a taste of what you can do and sets you apart from the crowd.

Tip Number 3

Prepare for interviews by brushing up on common AI testing scenarios and challenges. Practice explaining your thought process and how you tackle edge cases—this will show you're ready for the real-world complexities of the role.

Tip Number 4

Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our awesome team at CluePoints.

We think you need these skills to ace AI Test Engineer

AI Testing
Playwright Automation Framework
JavaScript
TypeScript
Understanding of AI/ML Concepts
Validation Strategy Design
Exploratory Testing

Some tips for your application 🫡

Show Your Passion for AI Testing:When you write your application, let your enthusiasm for AI testing shine through! Share specific examples of your experience with AI-driven systems and how you've tackled challenges in this area. We love seeing candidates who are genuinely excited about the technology.

Tailor Your CV and Cover Letter:Make sure to customise your CV and cover letter for the AI Test Engineer role. Highlight your Playwright expertise and any relevant projects you've worked on. This shows us that you’ve done your homework and understand what we’re looking for!

Be Clear and Concise:Keep your application clear and to the point. Use bullet points where possible to make it easy for us to read. We appreciate a well-structured application that gets straight to the important bits without unnecessary fluff.

Apply Through Our Website:Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it gives you a chance to explore more about our company culture and values.

How to prepare for a job interview at CluePoints

Know Your AI Inside Out

Make sure you brush up on your knowledge of AI-driven systems, especially those related to LLMs and ML models. Be ready to discuss how you’ve handled edge cases and non-deterministic outputs in your previous roles. This will show that you understand the complexities of AI testing.

Show Off Your Playwright Skills

Since strong Playwright expertise is a must for this role, prepare to demonstrate your hands-on experience with the framework. Bring examples of automation scripts you've written and be ready to explain your thought process behind them. This will highlight your technical prowess.

Discuss Real-World Scenarios

CluePoints values practical application, so think of specific instances where you tested AI features in real-world scenarios. Share how you approached validation strategies for probabilistic systems and what challenges you faced. This will illustrate your problem-solving skills.

Embrace Collaboration and Continuous Learning

Given the dynamic culture at CluePoints, express your enthusiasm for collaboration and learning. Share examples of how you’ve worked in diverse teams or adapted to new technologies. This will resonate well with their values of Care, Passion, and Smart Disruption.