Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Develop Python-based test automation tools and support AI testing frameworks.
- Company: Join Reply, a leader in QA and software testing focused on innovative digital solutions.
- Benefits: Enjoy opportunities for rapid career progression and work in a cutting-edge AI-driven environment.
- Why this job: Shape AI testing standards while collaborating with experts in a dynamic and inclusive culture.
- Qualifications: Bachelor’s or Master’s in Computer Science or related field; proficiency in Python required.
- Other info: We are an Equal Opportunities Employer committed to diversity and fair recruitment practices.
The predicted salary is between 28800 - 48000 £ per year.
Reply is a QA and software testing company focused on delivering high-quality digital solutions. We provide governance and production monitoring to ensure ongoing performance and compliance after release. Through advanced test automation and AI-driven testing strategies, we help organizations accelerate development, reduce risk, and ensure reliability across the entire software lifecycle. Our goal is to transform QA into a strategic driver of innovation and efficiency.
Role Overview: We are looking for a Graduate AI Test Automation Engineer with expertise in Python and a strong interest in Artificial Intelligence. You will support the development of an innovative testing framework for generative AI agents, designing tools for test data generation, automating evaluation processes, and contributing to AI model quality metrics such as accuracy, bias, and consistency. This position offers the opportunity to work on a cutting-edge project shaping AI testing standards, collaborating with experts in AI, testing, and data governance, with potential for rapid career progression in a high-impact, AI-driven environment.
Responsibilities:
- Develop and maintain Python-based test automation tools
- Collaborate on framework design and third-party tool integration
- Define and implement test strategies for LLM behaviour validation
- Support continuous testing, benchmarking, and KPI tracking
About the Candidate:
- On track to complete or have already completed a Bachelor’s or Master’s degree in Computer Science, AI, or a related field (minimum 2.1 grade)
- Strong interest in AI-driven software testing and development
- Proficient in Python and data libraries
- Familiarity with LLMs and testing tools (e.g., PyTest, Playwright) is a major asset
- Initial experience with datasets and evaluation metrics (e.g., BLEU, ROUGE) is beneficial
- Analytical mindset and collaborative problem-solving approach
Reply is an Equal Opportunities Employer committed to diversity and non-discrimination in the workplace. We provide equal employment opportunities to all employees and applicants, regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnicity, disability, medical history, skin colour, marital or parental status, or any other characteristic protected by law. We are dedicated to fair recruitment practices and encourage applicants to inform us of any reasonable adjustments needed during the process.
GRADUATE AI TEST AUTOMATION ENGINEER employer: Reply, Inc.
Contact Detail:
Reply, Inc. Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land GRADUATE AI TEST AUTOMATION ENGINEER
✨Tip Number 1
Familiarise yourself with the latest trends in AI and test automation. Follow industry leaders on social media, read relevant blogs, and participate in online forums to stay updated. This knowledge will not only help you during interviews but also show your genuine interest in the field.
✨Tip Number 2
Engage in hands-on projects that involve Python and AI testing tools. Create a portfolio showcasing your work with frameworks like PyTest or Playwright. This practical experience can set you apart from other candidates and demonstrate your skills effectively.
✨Tip Number 3
Network with professionals in the QA and AI sectors. Attend meetups, webinars, or conferences where you can connect with industry experts. Building relationships can lead to valuable insights and potential referrals for job openings.
✨Tip Number 4
Prepare for technical interviews by practising coding challenges related to Python and AI testing. Use platforms like LeetCode or HackerRank to sharpen your problem-solving skills. Being well-prepared will boost your confidence and improve your chances of impressing the interviewers.
We think you need these skills to ace GRADUATE AI TEST AUTOMATION ENGINEER
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your relevant skills and experiences, particularly in Python and AI. Emphasise any projects or coursework related to test automation or AI-driven software testing.
Craft a Compelling Cover Letter: Write a cover letter that showcases your passion for AI and software testing. Mention specific experiences that align with the responsibilities of the Graduate AI Test Automation Engineer role and express your enthusiasm for contributing to innovative testing frameworks.
Showcase Relevant Projects: If you have worked on any projects involving Python, AI, or test automation, be sure to include them in your application. Describe your role, the technologies used, and the outcomes achieved to demonstrate your practical experience.
Highlight Your Analytical Skills: Since the role requires an analytical mindset, provide examples of how you've approached problem-solving in past experiences. This could include coursework, internships, or personal projects where you had to analyse data or develop testing strategies.
How to prepare for a job interview at Reply, Inc.
✨Showcase Your Python Skills
Since the role requires proficiency in Python, be prepared to discuss your experience with the language. Bring examples of projects you've worked on, especially those involving test automation or AI, and be ready to demonstrate your coding skills if asked.
✨Understand AI Testing Concepts
Familiarise yourself with AI-driven testing strategies and concepts like LLM behaviour validation. Be ready to discuss how you would approach testing generative AI agents and the importance of metrics such as accuracy and bias.
✨Prepare for Technical Questions
Expect technical questions related to test automation tools and frameworks. Brush up on tools like PyTest and Playwright, and be ready to explain how you would integrate third-party tools into a testing framework.
✨Demonstrate Your Analytical Mindset
The role requires an analytical mindset and collaborative problem-solving skills. Prepare examples from your academic or project work where you tackled complex problems, highlighting your thought process and teamwork.
