At a Glance
- Tasks: Evaluate AI behaviour, investigate defects, and enhance product quality through innovative QA processes.
- Company: Join a leading digital product consultancy with 20 years of experience in tech and design.
- Benefits: Flexible working options, exposure to cutting-edge AI, and real ownership of quality processes.
- Other info: Work closely with Product, Engineering, and AI teams in a collaborative environment.
- Why this job: Make an impact on AI-driven products and tackle complex problems with a dynamic team.
- Qualifications: Strong manual QA experience and ability to assess nuanced AI conversations.
The predicted salary is between 40000 - 50000 £ per year.
Type: Full-time Contract (until September)
Location: UK-based applicants only. You must live within 30 miles of one of our five UK offices: Edinburgh, Newcastle, Leeds, Manchester or London
Working pattern: Flexible (remote, hybrid, or in-office)
The role
We're looking for an AI QA Engineer to work across product quality, AI behaviour evaluation, and defect investigation. This is not a traditional QA role focused purely on scripted testing or automation. A key part of the role involves reviewing AI agent conversations and assessing whether responses were accurate, appropriate, and aligned to the expected customer experience. Because AI behaviour is not always deterministic, strong judgement, attention to detail, and communication skills are essential. You'll support release testing and regression prevention across the platform, carrying out structured manual QA across key journeys during release cycles to improve release confidence and reduce production issues. Outside release periods, you'll help improve automated coverage, refine QA processes, and investigate product or AI-related issues raised internally. You'll also investigate production and customer-reported issues, identifying whether problems are expected behaviour, configuration issues, or genuine defects before escalating clear issues to engineering teams.
Required experience
- Strong manual QA experience
- Experience building or maintaining automated test coverage
- Solid, hands-on experience working within an agentic software delivery lifecycle. You should be comfortable with the tooling, workflows, and quality considerations specific to agentic systems, not just AI products in general
- Strong written English and communication skills
- The ability to assess nuanced conversations and provide clear feedback
- Confidence investigating issues independently and making sound judgement calls
- The ability to think on your feet and reason about unfamiliar problem domains. We'll ask you to do this in the interview, so come ready to engage with specifics rather than general examples
Desirable experience
- Experience working with AI tooling, agent frameworks, or conversational AI platforms is a plus
What you'll get
- A varied role combining QA, AI evaluation, automation improvement, and product investigation rather than repetitive manual testing.
- The opportunity to work on AI-driven products where quality depends on judgement and context, not just predefined test cases.
- Real ownership over how quality processes evolve as AI capabilities continue to grow.
- Exposure to modern AI and agentic systems in a production environment.
- The chance to work closely with Product, Engineering, and AI teams on complex problems where there often isn't a single correct answer.
About hedgehog lab
We're a digital product consultancy with 20 years of experience, helping organisations solve complex problems through technology, design, and delivery.
Ready to apply? Submit your application below. Please note: we're unable to offer visa sponsorship for this role.
AI QA Engineer in Leeds employer: hedgehog lab
At hedgehog lab, we pride ourselves on being an excellent employer by fostering a flexible work culture that values innovation and collaboration. Our AI QA Engineer role offers unique opportunities for professional growth, allowing you to engage with cutting-edge AI technologies while working closely with diverse teams in a supportive environment. With offices across the UK, including vibrant cities like Edinburgh and London, you'll enjoy a dynamic workplace that encourages creativity and ownership in shaping quality processes.
StudySmarter Expert Advice🤫
We think this is how you could land AI QA Engineer in Leeds
✨Tip Number 1
Get to know the company and its products inside out. When you’re in that interview, show us you understand our AI-driven products and how quality is key to their success. It’ll make you stand out!
✨Tip Number 2
Practice your problem-solving skills! We love candidates who can think on their feet. Prepare for scenario-based questions where you might need to assess AI behaviour or troubleshoot issues.
✨Tip Number 3
Don’t just talk about your experience; bring it to life with examples. Share specific instances where you’ve tackled QA challenges or improved processes. We want to see your judgement and attention to detail in action!
✨Tip Number 4
Finally, apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows us you’re genuinely interested in joining our team at hedgehog lab.
We think you need these skills to ace AI QA Engineer in Leeds
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your manual QA experience and any work with AI tooling. We want to see how your skills match the role, so don’t be shy about showcasing relevant projects!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re excited about the AI QA Engineer role and how your background makes you a perfect fit. Keep it conversational but professional.
Showcase Your Communication Skills:Since strong written communication is key for this role, ensure your application is clear and concise. We love attention to detail, so double-check for any typos or awkward phrasing before hitting send!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way to ensure your application gets into the right hands and helps us keep track of all the amazing candidates like you!
How to prepare for a job interview at hedgehog lab
✨Know Your AI Inside Out
Make sure you brush up on your knowledge of AI behaviour and conversational AI platforms. Be prepared to discuss specific examples of how you've evaluated AI responses in the past, as this role requires a nuanced understanding of AI interactions.
✨Show Off Your QA Skills
Highlight your manual QA experience and any automated testing you've done. Be ready to explain your approach to assessing product quality and how you’ve tackled defect investigations. Specific examples will help demonstrate your expertise.
✨Communicate Clearly
Since strong communication skills are essential for this role, practice articulating your thoughts clearly and concisely. You might be asked to provide feedback on AI conversations, so think about how you would convey your insights effectively.
✨Think on Your Feet
Prepare for scenario-based questions where you'll need to reason through unfamiliar problems. Practise thinking critically and making sound judgement calls on the spot, as this is a key part of the interview process.
