At a Glance
- Tasks: Develop automated testing frameworks and ensure quality for AI-driven enterprise projects.
- Company: Join EPAM, a leading tech company in London with a focus on innovation.
- Benefits: Enjoy competitive salary, health insurance, stock options, and fun perks like free lunches.
- Other info: Collaborative Agile environment with great learning and career growth opportunities.
- Why this job: Be part of transformative AI projects and shape the future of intelligent automation.
- Qualifications: Strong Python skills and experience in test automation are essential.
The predicted salary is between 55000 - 65000 £ per year.
We're looking for a Python QA Automation Engineer to join EPAM in London, in an onsite working mode, contributing to an AI-driven enterprise project for one of our clients. This role focuses on exposing internal enterprise tooling to AI agents via Model Context Protocol (MCP), ensuring robust quality engineering and compliance across innovative intelligent automation solutions.
As a Python QA Automation Engineer, you will be responsible for developing automated testing frameworks, evaluation pipelines, and quality controls for MCP Components within our AI platform. You will work closely with engineering and product teams in a Classic Agile environment to guarantee the reliability, accuracy, and performance of agent-driven workflows operating in enterprise-scale systems. This position offers a chance to define standards for testing AI models and tools in production-like environments while being a critical part of one of EPAM’s most transformative projects.
Responsibilities
- Develop automated testing frameworks to validate MCP Servers and related AI systems
- Design and implement evaluation strategies for LLM accuracy, safety, and reliability
- Create automated tests using Python, Pytest, and BDD frameworks
- Build quality gates into CI/CD pipelines to maintain continuous assurance
- Identify and address agentic AI failure modes such as hallucination, latency, and incorrect tool usage
- Collaborate with engineering, QA, and product teams to define quality metrics and acceptance criteria
- Contribute to Agile ceremonies, ensuring testing practices align with sprint goals
- Prepare detailed reporting on quality outcomes and improvement opportunities
- Maintain documentation for test cases, evaluation pipelines, and validation strategies
Requirements
- Strong programming experience in Python applied to test automation and evaluation
- Expertise in Pytest and familiarity with BDD frameworks such as Behave or Cucumber
- Knowledge of LLM evaluation approaches including RAGAS, DeepEval, or custom pipelines
- Understanding of common agentic AI issues such as hallucination, tool misuse, and performance bottlenecks
- Familiarity with automated testing of AI workflows, distributed systems, or microservices environments
- Strong grasp of Agile delivery methodologies and CI/CD integration for quality checks
- Excellent communication and problem-solving skills with a focus on accuracy and reliability
Nice to have
- Experience with Model Context Protocol (MCP) or other agent orchestration solutions
- Exposure to observability, monitoring, or logging tools for AI systems
- API and service integration testing background for multi-layered platforms
- Knowledge of containerized environments and cloud-native architecture
- Background in enterprise AI automation projects or intelligent platform engineering
We offer
- EPAM Employee Stock Purchase Plan (ESPP)
- Protection benefits including life assurance, income protection and critical illness cover
- Private medical insurance and dental care
- Employee Assistance Program
- Competitive group pension plan
- Cyclescheme, Techscheme and season ticket loans
- Various perks such as free Wednesday lunch in-office, on-site massages and regular social events
- Learning and development opportunities including in-house training and coaching, professional certifications, and courses
- If otherwise eligible, participation in the discretionary annual bonus program
- If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program
Python QA Automation Engineer in London employer: EPAM Systems, Inc.
EPAM is an exceptional employer, offering a dynamic work environment in London where innovation meets collaboration. As a Python QA Automation Engineer, you will benefit from a strong focus on employee growth through in-house training and professional certifications, alongside competitive perks like private medical insurance and regular social events. Join us to be part of transformative AI projects while enjoying a supportive culture that values quality engineering and continuous improvement.
StudySmarter Expert Advice🤫
We think this is how you could land Python QA Automation Engineer in London
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with current employees at EPAM. A friendly chat can sometimes lead to opportunities that aren’t even advertised.
✨Tip Number 2
Show off your skills! Create a GitHub repository showcasing your Python automation projects or any relevant work. This gives potential employers a sneak peek into your coding style and problem-solving abilities.
✨Tip Number 3
Prepare for interviews by brushing up on common QA automation questions and scenarios. Practice explaining your thought process when tackling problems, especially those related to AI workflows and testing frameworks.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who take the initiative to engage directly with us.
We think you need these skills to ace Python QA Automation Engineer in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Python QA Automation Engineer role. Highlight your experience with Python, Pytest, and any relevant frameworks. We want to see how your skills match what we're looking for!
Showcase Your Projects:Include specific projects where you've developed automated testing frameworks or worked with AI systems. This gives us a clear picture of your hands-on experience and how you can contribute to our team.
Be Clear and Concise:When writing your application, keep it clear and to the point. Use bullet points for easy reading and make sure to highlight your key achievements. We appreciate straightforward communication!
Apply Through Our Website:Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to hear from you!
How to prepare for a job interview at EPAM Systems, Inc.
✨Know Your Python Inside Out
Make sure you brush up on your Python skills, especially in the context of test automation. Be ready to discuss how you've used Python in previous projects, particularly with frameworks like Pytest and BDD tools. Practising coding challenges can also help you demonstrate your problem-solving abilities.
✨Familiarise Yourself with AI Concepts
Since this role involves working with AI-driven systems, it’s crucial to understand concepts like LLM evaluation and common issues such as hallucination and tool misuse. Prepare examples of how you've tackled these challenges in past roles or projects to show your expertise.
✨Showcase Your Agile Experience
This position requires collaboration in a Classic Agile environment, so be prepared to discuss your experience with Agile methodologies. Think of specific instances where you contributed to sprint goals or Agile ceremonies, and how that impacted the quality of the project.
✨Prepare Questions for Them
Interviews are a two-way street! Prepare insightful questions about their AI projects, team dynamics, or testing standards. This not only shows your interest but also helps you gauge if the company culture aligns with your values and work style.
