Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Develop and maintain Python-based test automation tools for AI-driven projects.
- Company: Join a leading QA and software testing company focused on innovation.
- Benefits: Competitive salary, career progression, and a collaborative work environment.
- Why this job: Shape the future of AI testing while working with industry experts.
- Qualifications: Bachelor's or Master's in Computer Science or related field; proficient in Python.
- Other info: Diverse workplace committed to equal opportunities and personal growth.
The predicted salary is between 36000 - 60000 £ per year.
Concept Quality Reply is a QA and software testing company focused on delivering high-quality digital solutions. We provide governance and production monitoring to ensure ongoing performance and compliance after release. Through advanced test automation and AI-driven testing strategies, we help organizations accelerate development, reduce risk and ensure reliability across the entire software lifecycle. Our goal is to transform QA into a strategic driver of innovation and efficiency.
Role Overview: We are looking for a Graduate AI Test Automation Engineer with expertise in Python and a strong interest in Artificial Intelligence who will support the development of an innovative testing framework for generative AI agents. You will be involved in designing tools for test data generation, automating evaluation processes, and contributing to AI model quality metrics (such as accuracy, bias, consistency and more). This position will allow you to join a cutting-edge project shaping AI testing standards. You’ll work with experts in AI, testing, and data governance and will be offered opportunities for quick career progression in a high-impact, AI-driven environment.
Responsibilities:
- As an AI Test Automation Engineer, you will develop and maintain Python-based test automation tools.
- You’ll collaborate on framework design and third-party tool integration.
- In this role, you’ll define and implement test strategies for LLM behaviour validation.
- Support continuous testing, benchmarking, and KPI tracking.
About the candidate:
- You’re on track to complete (or have already completed) a Bachelor’s or Master’s degree in Computer Science, AI, or in a related field (2.1 min grade).
- Strong interest in AI-driven software testing and development.
- You’re proficient in Python and data libraries.
- Familiarity with LLMs and testing tools (PyTest, Playwright, etc.) would be a major asset for this role.
- Initial experience with datasets and evaluation metrics (BLEU, ROUGE, etc.) is beneficial.
- You can demonstrate an analytical mindset and enjoy following a collaborative approach to solving problems.
Reply is an Equal Opportunities Employer and committed to embracing diversity in the workplace. We provide equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnic origin, disability, medical history, skin colour, marital status or parental status or any other characteristic protected by the Law. Reply is committed to making sure that our selection methods are fair to everyone. To help you during the recruitment process, please let us know of any Reasonable Adjustments you may need.
Test Automation Consultant employer: Reply
Contact Detail:
Reply Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Test Automation Consultant
✨Tip Number 1
Network like a pro! Reach out to people in the industry, attend meetups, and connect on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Python and AI. This will give potential employers a taste of what you can do and set you apart from the crowd.
✨Tip Number 3
Prepare for interviews by practising common questions and coding challenges. Brush up on your knowledge of LLMs and testing tools, as these are hot topics in the field right now.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who take that extra step!
We think you need these skills to ace Test Automation Consultant
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the role of AI Test Automation Engineer. Highlight your Python skills and any relevant projects or coursework that showcase your interest in AI-driven testing. We want to see how you fit into our innovative team!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about AI and software testing. Share specific examples of your experience with Python and any tools you've used, like PyTest or Playwright. Let us know what excites you about this role!
Show Off Your Analytical Skills: In your application, don’t forget to demonstrate your analytical mindset. Mention any experience you have with datasets and evaluation metrics like BLEU or ROUGE. We love seeing candidates who can think critically and solve problems collaboratively!
Apply Through Our Website: We encourage you to apply through our website for a smoother process. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team at Concept Quality Reply!
How to prepare for a job interview at Reply
✨Know Your Python Inside Out
Make sure you brush up on your Python skills before the interview. Be ready to discuss your experience with Python-based test automation tools and how you've used them in past projects. Practising coding challenges can also help you demonstrate your proficiency.
✨Familiarise Yourself with AI Testing Concepts
Since the role focuses on AI-driven testing, it’s crucial to understand key concepts like LLM behaviour validation and evaluation metrics such as BLEU and ROUGE. Prepare to discuss how these concepts apply to the role and any relevant experiences you have.
✨Showcase Your Collaborative Spirit
This position involves working closely with experts in AI and testing. Be prepared to share examples of how you've successfully collaborated in team settings. Highlight your problem-solving approach and how you value input from others.
✨Ask Insightful Questions
Interviews are a two-way street! Prepare thoughtful questions about the company’s approach to AI testing and the specific projects you might be involved in. This shows your genuine interest in the role and helps you assess if it's the right fit for you.
