At a Glance
- Tasks: Develop automated testing frameworks and ensure quality for AI-driven enterprise projects.
- Company: Join EPAM, a leading tech company in London with a focus on innovation.
- Benefits: Enjoy competitive salary, health insurance, and perks like free lunches and social events.
- Other info: Dynamic Agile environment with excellent learning and career growth opportunities.
- Why this job: Be part of transformative AI projects and shape the future of intelligent automation.
- Qualifications: Strong Python skills and experience in test automation are essential.
The predicted salary is between 55000 - 65000 £ per year.
We're looking for a Python QA Automation Engineer to join EPAM in London, in an onsite working mode, contributing to an AI-driven enterprise project for one of our clients. This role focuses on exposing internal enterprise tooling to AI agents via Model Context Protocol (MCP), ensuring robust quality engineering and compliance across innovative intelligent automation solutions.
As a Python QA Automation Engineer, you will be responsible for developing automated testing frameworks, evaluation pipelines, and quality controls for MCP Components within our AI platform. You will work closely with engineering and product teams in a Classic Agile environment to guarantee the reliability, accuracy, and performance of agent-driven workflows operating in enterprise-scale systems. This position offers a chance to define standards for testing AI models and tools in production-like environments while being a critical part of one of EPAM’s most transformative projects.
Responsibilities- Develop automated testing frameworks to validate MCP Servers and related AI systems
- Design and implement evaluation strategies for LLM accuracy, safety, and reliability
- Create automated tests using Python, Pytest, and BDD frameworks
- Build quality gates into CI/CD pipelines to maintain continuous assurance
- Identify and address agentic AI failure modes such as hallucination, latency, and incorrect tool usage
- Collaborate with engineering, QA, and product teams to define quality metrics and acceptance criteria
- Contribute to Agile ceremonies, ensuring testing practices align with sprint goals
- Prepare detailed reporting on quality outcomes and improvement opportunities
- Maintain documentation for test cases, evaluation pipelines, and validation strategies
- Strong programming experience in Python applied to test automation and evaluation
- Expertise in Pytest and familiarity with BDD frameworks such as Behave or Cucumber
- Knowledge of LLM evaluation approaches including RAGAS, DeepEval, or custom pipelines
- Understanding of common agentic AI issues such as hallucination, tool misuse, and performance bottlenecks
- Familiarity with automated testing of AI workflows, distributed systems, or microservices environments
- Strong grasp of Agile delivery methodologies and CI/CD integration for quality checks
- Excellent communication and problem-solving skills with a focus on accuracy and reliability
- Experience with Model Context Protocol (MCP) or other agent orchestration solutions
- Exposure to observability, monitoring, or logging tools for AI systems
- API and service integration testing background for multi-layered platforms
- Knowledge of containerized environments and cloud-native architecture
- Background in enterprise AI automation projects or intelligent platform engineering
- EPAM Employee Stock Purchase Plan (ESPP)
- Protection benefits including life assurance, income protection and critical illness cover
- Private medical insurance and dental care
- Employee Assistance Program
- Cyclescheme, Techscheme and season ticket loans
- Various perks such as free Wednesday lunch in-office, on-site massages and regular social events
- Learning and development opportunities including in-house training and coaching, professional certifications, and courses
- If otherwise eligible, participation in the discretionary annual bonus program
- If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program
Python QA Automation Engineer employer: EPAM Systems
EPAM is an exceptional employer, offering a dynamic work environment in London where innovation meets collaboration. As a Python QA Automation Engineer, you will benefit from a strong focus on employee growth through in-house training and professional certifications, alongside unique perks like free lunches and on-site massages. Join us to be part of transformative AI projects while enjoying a supportive culture that prioritises quality and teamwork.
StudySmarter Expert Advice🤫
We think this is how you could land Python QA Automation Engineer
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with current EPAM employees on LinkedIn. A personal introduction can make all the difference when applying for that Python QA Automation Engineer role.
✨Tip Number 2
Prepare for those interviews by brushing up on your Python skills and understanding the latest in AI testing frameworks. Practice common interview questions related to automated testing and be ready to showcase your problem-solving abilities.
✨Tip Number 3
Don’t just apply anywhere; focus on EPAM’s website! Tailor your application to highlight your experience with Pytest and BDD frameworks, as well as your understanding of Agile methodologies. Show them you’re the perfect fit for their team!
✨Tip Number 4
Follow up after your interviews! A quick thank-you email can keep you top of mind and show your enthusiasm for the role. Plus, it’s a great chance to reiterate why you’d be an awesome addition to the EPAM team.
We think you need these skills to ace Python QA Automation Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your Python programming skills and experience with test automation. We want to see how your background aligns with the role, so don’t be shy about showcasing relevant projects or achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re excited about the Python QA Automation Engineer position and how your skills can contribute to our AI-driven projects. Keep it engaging and personal!
Showcase Your Technical Skills:When filling out your application, be specific about your experience with tools like Pytest and BDD frameworks. We love seeing candidates who can demonstrate their expertise in automated testing and quality assurance.
Apply Through Our Website:We encourage you to apply directly through our website for the best chance of getting noticed. It’s super easy, and you’ll be one step closer to joining our amazing team at EPAM!
How to prepare for a job interview at EPAM Systems
✨Know Your Python Inside Out
Make sure you brush up on your Python skills, especially in the context of test automation. Be ready to discuss your experience with frameworks like Pytest and any BDD tools you've used. They’ll likely want to see how you can apply your programming knowledge to real-world testing scenarios.
✨Familiarise Yourself with AI Concepts
Since this role involves working with AI-driven projects, it’s crucial to understand concepts like LLM evaluation and common issues such as hallucination and tool misuse. Prepare to talk about how you’ve tackled these challenges in past projects or how you would approach them.
✨Showcase Your Agile Experience
This position is set in a Classic Agile environment, so be ready to discuss your experience with Agile methodologies. Highlight how you’ve contributed to Agile ceremonies and how you ensure that testing practices align with sprint goals. They’ll want to see that you can work collaboratively within a team.
✨Prepare for Technical Questions
Expect technical questions that may involve coding challenges or problem-solving scenarios related to automated testing frameworks. Practice coding on a whiteboard or in a shared document, and be prepared to explain your thought process clearly. This will demonstrate your analytical skills and ability to communicate effectively.
