At a Glance
- Tasks: Develop automated testing frameworks and ensure quality for AI-driven enterprise projects.
- Company: Join EPAM, a leading tech company in London with a focus on innovation.
- Benefits: Enjoy competitive salary, health insurance, and perks like free lunches and social events.
- Other info: Dynamic Agile environment with excellent learning and career growth opportunities.
- Why this job: Be part of transformative AI projects and shape the future of intelligent automation.
- Qualifications: Strong Python skills and experience in test automation are essential.
The predicted salary is between 50000 - 70000 £ per year.
We're looking for a Python QA Automation Engineer to join EPAM in London, in an onsite working mode, contributing to an AI-driven enterprise project for one of our clients. This role focuses on exposing internal enterprise tooling to AI agents via Model Context Protocol (MCP), ensuring robust quality engineering and compliance across innovative intelligent automation solutions.
As a Python QA Automation Engineer, you will be responsible for developing automated testing frameworks, evaluation pipelines, and quality controls for MCP Components within our AI platform. You will work closely with engineering and product teams in a Classic Agile environment to guarantee the reliability, accuracy, and performance of agent-driven workflows operating in enterprise-scale systems. This position offers a chance to define standards for testing AI models and tools in production-like environments while being a critical part of one of EPAM’s most transformative projects.
Responsibilities- Develop automated testing frameworks to validate MCP Servers and related AI systems
- Design and implement evaluation strategies for LLM accuracy, safety, and reliability
- Create automated tests using Python, Pytest, and BDD frameworks
- Build quality gates into CI/CD pipelines to maintain continuous assurance
- Identify and address agentic AI failure modes such as hallucination, latency, and incorrect tool usage
- Collaborate with engineering, QA, and product teams to define quality metrics and acceptance criteria
- Contribute to Agile ceremonies, ensuring testing practices align with sprint goals
- Prepare detailed reporting on quality outcomes and improvement opportunities
- Maintain documentation for test cases, evaluation pipelines, and validation strategies
- Strong programming experience in Python applied to test automation and evaluation
- Expertise in Pytest and familiarity with BDD frameworks such as Behave or Cucumber
- Knowledge of LLM evaluation approaches including RAGAS, DeepEval, or custom pipelines
- Understanding of common agentic AI issues such as hallucination, tool misuse, and performance bottlenecks
- Familiarity with automated testing of AI workflows, distributed systems, or microservices environments
- Strong grasp of Agile delivery methodologies and CI/CD integration for quality checks
- Excellent communication and problem-solving skills with a focus on accuracy and reliability
- Experience with Model Context Protocol (MCP) or other agent orchestration solutions
- Exposure to observability, monitoring, or logging tools for AI systems
- API and service integration testing background for multi-layered platforms
- Knowledge of containerized environments and cloud-native architecture
- Background in enterprise AI automation projects or intelligent platform engineering
- EPAM Employee Stock Purchase Plan (ESPP)
- Protection benefits including life assurance, income protection and critical illness cover
- Private medical insurance and dental care
- Employee Assistance Program
- Cyclescheme, Techscheme and season ticket loans
- Various perks such as free Wednesday lunch in-office, on-site massages and regular social events
- Learning and development opportunities including in-house training and coaching, professional certifications, and courses
- If otherwise eligible, participation in the discretionary annual bonus program
- If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program
Python QA Automation Engineer in London employer: EPAM Systems
EPAM is an exceptional employer that fosters a dynamic and innovative work culture in the heart of London, offering Python QA Automation Engineers the opportunity to contribute to cutting-edge AI projects. With a strong emphasis on employee growth through in-house training, professional certifications, and a range of benefits including private medical insurance and a vibrant social environment, EPAM ensures that its team members thrive both personally and professionally. The collaborative Agile setting and commitment to quality engineering make this role not just a job, but a meaningful career path in the rapidly evolving tech landscape.
StudySmarter Expert Advice🤫
We think this is how you could land Python QA Automation Engineer in London
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with current EPAM employees on LinkedIn. A friendly chat can sometimes lead to job opportunities that aren't even advertised!
✨Tip Number 2
Show off your skills! Create a GitHub repository showcasing your Python automation projects or any relevant work. This gives potential employers a sneak peek into your coding style and problem-solving abilities.
✨Tip Number 3
Prepare for interviews by brushing up on common QA automation questions and scenarios. Practice explaining your thought process when developing automated tests and how you tackle challenges in AI systems.
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets seen by the right people at EPAM. Plus, it shows you're genuinely interested in joining our team!
We think you need these skills to ace Python QA Automation Engineer in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your Python programming skills and experience with test automation. We want to see how your background aligns with the role, so don’t be shy about showcasing relevant projects or achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re excited about the Python QA Automation Engineer position and how your skills can contribute to our AI-driven projects. Keep it engaging and personal!
Showcase Your Technical Skills:When filling out your application, be specific about your experience with tools like Pytest and BDD frameworks. We love seeing concrete examples of how you've tackled challenges in automated testing and quality assurance.
Apply Through Our Website:We encourage you to apply directly through our website for the best chance of getting noticed. It’s super easy, and you’ll be one step closer to joining our awesome team at EPAM!
How to prepare for a job interview at EPAM Systems
✨Know Your Python Inside Out
Make sure you brush up on your Python skills, especially in the context of test automation. Be ready to discuss your experience with frameworks like Pytest and any BDD tools you've used. They’ll likely want to see how you can apply your programming knowledge to real-world testing scenarios.
✨Familiarise Yourself with AI Concepts
Since this role involves working with AI-driven projects, it’s crucial to understand concepts like LLM evaluation and common issues such as hallucination and tool misuse. Prepare to talk about how you’ve tackled these challenges in past projects or how you would approach them.
✨Showcase Your Agile Experience
This position is set in a Classic Agile environment, so be ready to discuss your experience with Agile methodologies. Highlight how you’ve contributed to sprint goals and collaborated with cross-functional teams to ensure quality metrics are met.
✨Prepare for Technical Questions
Expect technical questions that may involve coding challenges or problem-solving scenarios related to automated testing frameworks. Practise coding on a whiteboard or in an online coding environment to get comfortable with articulating your thought process while solving problems.
