Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Develop innovative Python-based test automation tools for AI-driven projects.
- Company: Join a leading QA and software testing company focused on digital solutions.
- Benefits: Enjoy competitive salary, career progression, and a collaborative work environment.
- Why this job: Shape the future of AI testing while working with industry experts.
- Qualifications: Bachelor's or Master's in Computer Science or related field; Python proficiency required.
- Other info: Diverse workplace committed to equal opportunities and personal growth.
The predicted salary is between 28800 - 48000 £ per year.
Reply is a QA and software testing company focused on delivering high-quality digital solutions. We provide governance and production monitoring to ensure ongoing performance and compliance after release. Through advanced test automation and AI-driven testing strategies, we help organizations accelerate development, reduce risk and ensure reliability across the entire software lifecycle. Our goal is to transform QA into a strategic driver of innovation and efficiency.
We are looking for a Graduate AI Test Automation Engineer with expertise in Python and a strong interest in Artificial Intelligence who will support the development of an innovative testing framework for generative AI agents. You will be involved in designing tools for test data generation, automating evaluation processes, and contributing to AI model quality metrics (such as accuracy, bias, consistency and more). This position will allow you to join a cutting‑edge project shaping AI testing standards. You will work with experts in AI, testing, and data governance and will be offered opportunities for quick career progression in a high‑impact, AI-driven environment.
Responsibilities:
- Develop and maintain Python-based test automation tools.
- Collaborate on framework design and third‑party tool integration.
- Define and implement test strategies for LLM behavior validation.
- Support continuous testing, benchmarking, and KPI tracking.
About the candidate:
- On track to complete (or have already completed) a Bachelor's or Master's degree in Computer Science, AI, or a related field (minimum 2.1).
- Strong interest in AI-driven software testing and development.
- Proficient in Python and data libraries.
- Familiarity with LLMs and testing tools (PyTest, Playwright, etc.) is a major asset.
- Initial experience with datasets and evaluation metrics (BLEU, ROUGE, etc.) is beneficial.
- Demonstrate an analytical mindset and enjoy following a collaborative approach to solving problems.
Reply is an Equal Opportunities Employer and committed to embracing diversity in the workplace. We provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnic origin, disability, medical history, skin colour, marital status or parental status or any other characteristic protected by the Law. Reply is committed to making sure that our selection methods are fair to everyone. To help you during the recruitment process, please let us know of any Reasonable Adjustments you may need.
Graduate AI Test Automation Engineer (10680) employer: Reply
Contact Detail:
Reply Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Graduate AI Test Automation Engineer (10680)
✨Tip Number 1
Network like a pro! Reach out to people in the industry, attend meetups, and connect on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your Python projects, especially those related to AI and test automation. This will give potential employers a taste of what you can do and set you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common technical questions and coding challenges. Practice makes perfect, so consider mock interviews with friends or use online platforms to get comfortable.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Graduate AI Test Automation Engineer (10680)
Some tips for your application 🫡
Show Off Your Python Skills: Make sure to highlight your proficiency in Python in your application. We want to see how you've used it in past projects or coursework, especially in relation to test automation and AI.
Express Your Passion for AI: Let us know why you're excited about AI-driven software testing! Share any relevant experiences or projects that showcase your interest and understanding of the field.
Tailor Your Application: Don’t just send a generic application. Tailor your CV and cover letter to reflect the specific skills and experiences that align with the Graduate AI Test Automation Engineer role. We love seeing candidates who take the time to connect their background to our needs.
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way to ensure your application gets into the right hands and shows us you’re serious about joining our team!
How to prepare for a job interview at Reply
✨Know Your Python Inside Out
Since the role requires proficiency in Python, make sure you brush up on your coding skills. Be prepared to discuss your previous projects and how you've used Python in test automation. Practising coding challenges can also help you feel more confident.
✨Familiarise Yourself with AI Testing Tools
Get to know tools like PyTest and Playwright before your interview. Understanding how these tools work and being able to discuss their applications in AI-driven testing will show your genuine interest and readiness for the role.
✨Showcase Your Analytical Mindset
Prepare examples that demonstrate your analytical thinking and problem-solving skills. Think of situations where you had to analyse data or metrics, especially in relation to AI models. This will highlight your fit for a role focused on quality metrics.
✨Ask Insightful Questions
Interviews are a two-way street! Prepare thoughtful questions about the company's approach to AI testing and the specific projects you'll be involved in. This not only shows your enthusiasm but also helps you gauge if the company aligns with your career goals.
