Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Develop and maintain Python-based test automation tools for AI testing.
- Company: Join a leading QA company focused on innovative digital solutions.
- Benefits: Fast career progression, collaborative environment, and opportunities to work with AI experts.
- Why this job: Shape the future of AI testing while working on cutting-edge projects.
- Qualifications: Bachelor's or Master's in Computer Science or related field; proficient in Python.
- Other info: Diverse workplace committed to equal opportunities and personal growth.
The predicted salary is between 28800 - 48000 £ per year.
Overview
Reply is a QA and software testing company focused on delivering high-quality digital solutions. We provide governance and production monitoring to ensure ongoing performance and compliance after release. Through advanced test automation and AI-driven testing strategies, we help organizations accelerate development, reduce risk and ensure reliability across the entire software lifecycle. Our goal is to transform QA into a strategic driver of innovation and efficiency.
Role Overview
We are looking for a Graduate AI Test Automation Engineer with expertise in Python and a strong interest in Artificial Intelligence who will support the development of an innovative testing framework for generative AI agents. You will be involved in designing tools for test data generation, automating evaluation processes, and contributing to AI model quality metrics (such as accuracy, bias, consistency and more). This position will allow you to join a cutting-edge project shaping AI testing standards. You will work with experts in AI, testing, and data governance and will be offered opportunities for quick career progression in a high-impact, AI-driven environment.
Responsibilities
- Develop and maintain Python-based test automation tools
- Collaborate on framework design and third-party tool integration
- Define and implement test strategies for LLM behaviour validation
- Support continuous testing, benchmarking, and KPI tracking
About the candidate
- You are on track to complete (or have already completed) a Bachelor’s or Master’s degree in Computer Science, AI, or in a related field
- Strong interest in AI-driven software testing and development
- You are proficient in Python and data libraries
- Familiarity with LLMs and testing tools (PyTest, Playwright, etc.) would be a major asset for this role
- Initial experience with datasets and evaluation metrics (BLEU, ROUGE, etc.) is beneficial
- You can demonstrate an analytical mindset and enjoy following a collaborative approach to solving problems
Equal Opportunity
Reply is an Equal Opportunities Employer and committed to embracing diversity in the workplace. We provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnic origin, disability, medical history, skin colour, marital status or parental status or any other characteristic protected by the Law. Reply is committed to making sure that our selection methods are fair to everyone. To help you during the recruitment process, please let us know of any Reasonable Adjustments you may need.
Graduate AI Test Automation Engineer in City of Westminster employer: Reply Ltd
Contact Detail:
Reply Ltd Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Graduate AI Test Automation Engineer in City of Westminster
✨Tip Number 1
Network like a pro! Reach out to people in the industry, attend meetups, and connect on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Python and AI. This will give potential employers a taste of what you can do and set you apart from the crowd.
✨Tip Number 3
Prepare for interviews by practising common questions and coding challenges. We recommend doing mock interviews with friends or using online platforms to get comfortable with the process.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Graduate AI Test Automation Engineer in City of Westminster
Some tips for your application 🫡
Show Off Your Python Skills: Make sure to highlight your proficiency in Python in your application. We want to see how you've used it in past projects or coursework, especially if it relates to AI or testing!
Express Your Passion for AI: Let us know why you're excited about AI-driven software testing! Share any relevant experiences or projects that showcase your interest and understanding of the field.
Tailor Your Application: Don’t just send a generic application. Take the time to tailor your CV and cover letter to reflect the specific skills and experiences that match the Graduate AI Test Automation Engineer role.
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way to ensure your application gets into the right hands and shows us you’re serious about joining our team!
How to prepare for a job interview at Reply Ltd
✨Know Your Python Inside Out
Make sure you brush up on your Python skills before the interview. Be ready to discuss your experience with Python-based test automation tools and any projects you've worked on. Practising coding challenges can also help you demonstrate your proficiency.
✨Familiarise Yourself with AI Testing Concepts
Since this role focuses on AI-driven testing, it’s crucial to understand key concepts like LLMs and evaluation metrics such as BLEU and ROUGE. Prepare to discuss how these concepts apply to the role and think of examples where you’ve used them or similar tools.
✨Showcase Your Analytical Mindset
Be prepared to share examples of how you've approached problem-solving in a collaborative environment. Think of specific instances where your analytical skills made a difference in a project, especially in testing or software development.
✨Ask Insightful Questions
Interviews are a two-way street! Prepare thoughtful questions about the company’s approach to AI testing and the innovative projects they’re working on. This shows your genuine interest in the role and helps you assess if it’s the right fit for you.
