Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Develop and maintain Python-based test automation tools for AI testing.
- Company: Join a leading QA and software testing company focused on innovation.
- Benefits: Competitive salary, career progression, and a collaborative work environment.
- Why this job: Shape the future of AI testing while working with industry experts.
- Qualifications: Bachelor's or Master's in Computer Science or related field; proficient in Python.
- Other info: Embrace diversity and enjoy a supportive workplace culture.
The predicted salary is between 28800 - 48000 £ per year.
Quality Reply is a QA and software testing company focused on delivering high-quality digital solutions. We provide governance and production monitoring to ensure ongoing performance and compliance after release. Through advanced test automation and AI-driven testing strategies, we help organizations accelerate development, reduce risk and ensure reliability across the entire software lifecycle. Our goal is to transform QA into a strategic driver of innovation and efficiency.
Role Overview: We are looking for a Graduate AI Test Automation Engineer with expertise in Python and a strong interest in Artificial Intelligence who will support the development of an innovative testing framework for generative AI agents. You will be involved in designing tools for test data generation, automating evaluation processes, and contributing to AI model quality metrics (such as accuracy, bias, consistency and more). This position will allow you to join a cutting-edge project shaping AI testing standards. You’ll work with experts in AI, testing, and data governance and will be offered opportunities for quick career progression in a high-impact, AI-driven environment.
Responsibilities:
- As an AI Test Automation Engineer, you will develop and maintain Python-based test automation tools.
- You’ll collaborate on framework design and third-party tool integration.
- In this role, you’ll define and implement test strategies for LLM behavior validation.
- Support continuous testing, benchmarking, and KPI tracking.
About the candidate:
- You’re on track to complete (or have already completed) a Bachelor’s or Master’s degree in Computer Science, AI, or in a related field (2.1 min grade).
- Strong interest in AI-driven software testing and development.
- You’re proficient in Python and data libraries.
- Familiarity with LLMs and testing tools (PyTest, Playwright, etc.) would be a major asset for this role.
- Initial experience with datasets and evaluation metrics (BLEU, ROUGE, etc.) is beneficial.
- You can demonstrate an analytical mindset and enjoy following a collaborative approach to solving problems.
Reply is an Equal Opportunities Employer and committed to embracing diversity in the workplace. We provide equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnic origin, disability, medical history, skin colour, marital status or parental status or any other characteristic protected by the Law. Reply is committed to making sure that our selection methods are fair to everyone. To help you during the recruitment process, please let us know of any Reasonable Adjustments you may need.
GRADUATE AI TEST AUTOMATION ENGINEER employer: Reply, Inc.
Contact Detail:
Reply, Inc. Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land GRADUATE AI TEST AUTOMATION ENGINEER
✨Tip Number 1
Network like a pro! Reach out to people in the industry, attend meetups, and connect on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Prepare for interviews by practising common questions and showcasing your Python skills. Get comfortable talking about your projects and how they relate to AI testing. Confidence is key!
✨Tip Number 3
Don’t just apply anywhere; focus on companies that excite you, like us at StudySmarter! Tailor your approach to show why you’re a perfect fit for our innovative environment.
✨Tip Number 4
Follow up after interviews with a thank-you note. It shows your enthusiasm and keeps you fresh in their minds. Plus, it’s a great chance to reiterate your interest in the role!
We think you need these skills to ace GRADUATE AI TEST AUTOMATION ENGINEER
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Graduate AI Test Automation Engineer role. Highlight your Python skills and any relevant projects or coursework related to AI and testing. We want to see how your background fits with what we're doing!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Share your passion for AI-driven software testing and explain why you’re excited about this opportunity at StudySmarter. Let us know what makes you tick and how you can contribute to our innovative team.
Showcase Relevant Experience: Even if you don’t have extensive work experience, include any internships, projects, or coursework that demonstrate your skills in Python, data libraries, and testing tools. We love seeing practical applications of your knowledge!
Apply Through Our Website: Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team at StudySmarter!
How to prepare for a job interview at Reply, Inc.
✨Know Your Python Inside Out
Since the role requires proficiency in Python, make sure you brush up on your coding skills. Be prepared to discuss your previous projects and how you've used Python in test automation. Practising coding challenges can also help you feel more confident.
✨Familiarise Yourself with AI Testing Tools
Get to know tools like PyTest and Playwright before your interview. Understanding how these tools work and being able to discuss their applications in AI-driven testing will show your genuine interest and readiness for the role.
✨Showcase Your Analytical Mindset
Prepare examples that demonstrate your analytical thinking and problem-solving skills. Think of situations where you had to analyse data or metrics, especially in relation to AI models. This will highlight your fit for a role focused on quality metrics.
✨Emphasise Collaboration Skills
This position involves working closely with experts in AI and testing. Be ready to talk about your experiences in team settings, how you approach collaboration, and any specific instances where teamwork led to successful outcomes in your projects.
