At a Glance
- Tasks: Develop automated testing frameworks and ensure quality for AI-driven enterprise projects.
- Company: Join EPAM, a leading tech company in London with a focus on innovation.
- Benefits: Enjoy competitive salary, health benefits, and perks like free lunches and on-site massages.
- Other info: Great opportunities for learning, development, and career growth in a dynamic environment.
- Why this job: Be part of transformative AI projects and shape the future of intelligent automation.
- Qualifications: Strong Python skills and experience in test automation and Agile methodologies.
The predicted salary is between 55000 - 65000 £ per year.
We're looking for a Python QA Automation Engineer to join EPAM in London, in an onsite working mode, contributing to an AI-driven enterprise project for one of our clients. This role focuses on exposing internal enterprise tooling to AI agents via Model Context Protocol (MCP), ensuring robust quality engineering and compliance across innovative intelligent automation solutions.
As a Python QA Automation Engineer, you will be responsible for developing automated testing frameworks, evaluation pipelines, and quality controls for MCP Components within our AI platform. You will work closely with engineering and product teams in a Classic Agile environment to guarantee the reliability, accuracy, and performance of agent-driven workflows operating in enterprise-scale systems. This position offers a chance to define standards for testing AI models and tools in production-like environments while being a critical part of one of EPAM’s most transformative projects.
Responsibilities- Develop automated testing frameworks to validate MCP Servers and related AI systems
- Design and implement evaluation strategies for LLM accuracy, safety, and reliability
- Create automated tests using Python, Pytest, and BDD frameworks
- Build quality gates into CI/CD pipelines to maintain continuous assurance
- Identify and address agentic AI failure modes such as hallucination, latency, and incorrect tool usage
- Collaborate with engineering, QA, and product teams to define quality metrics and acceptance criteria
- Contribute to Agile ceremonies, ensuring testing practices align with sprint goals
- Prepare detailed reporting on quality outcomes and improvement opportunities
- Maintain documentation for test cases, evaluation pipelines, and validation strategies
- Strong programming experience in Python applied to test automation and evaluation
- Expertise in Pytest and familiarity with BDD frameworks such as Behave or Cucumber
- Knowledge of LLM evaluation approaches including RAGAS, DeepEval, or custom pipelines
- Understanding of common agentic AI issues such as hallucination, tool misuse, and performance bottlenecks
- Familiarity with automated testing of AI workflows, distributed systems, or microservices environments
- Strong grasp of Agile delivery methodologies and CI/CD integration for quality checks
- Excellent communication and problem-solving skills with a focus on accuracy and reliability
- Experience with Model Context Protocol (MCP) or other agent orchestration solutions
- Exposure to observability, monitoring, or logging tools for AI systems
- API and service integration testing background for multi-layered platforms
- Knowledge of containerized environments and cloud-native architecture
- Background in enterprise AI automation projects or intelligent platform engineering
- EPAM Employee Stock Purchase Plan (ESPP)
- Protection benefits including life assurance, income protection and critical illness cover
- Private medical insurance and dental care
- Employee Assistance Program
- Competitive group pension plan
- Cyclescheme, Techscheme and season ticket loans
- Various perks such as free Wednesday lunch in-office, on-site massages and regular social events
- Learning and development opportunities including in-house training and coaching, professional certifications, and courses
- If otherwise eligible, participation in the discretionary annual bonus program
- If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program
Python QA Automation Engineer employer: EPAM Systems, Inc.
EPAM is an exceptional employer for a Python QA Automation Engineer, offering a dynamic work environment in London that fosters innovation and collaboration. With a strong focus on employee growth through in-house training, professional certifications, and a vibrant work culture enriched by regular social events and unique perks, EPAM ensures that its team members are well-supported and engaged in meaningful projects. The opportunity to contribute to cutting-edge AI-driven solutions while enjoying comprehensive benefits, including private medical insurance and a competitive pension plan, makes EPAM a standout choice for those seeking a rewarding career.
StudySmarter Expert Advice🤫
We think this is how you could land Python QA Automation Engineer
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with current EPAM employees on LinkedIn. A friendly chat can sometimes lead to job opportunities that aren't even advertised!
✨Tip Number 2
Show off your skills! Create a GitHub repository showcasing your Python automation projects or any relevant work. This gives potential employers a sneak peek into your coding style and problem-solving abilities.
✨Tip Number 3
Prepare for interviews by brushing up on common QA automation questions and scenarios. Practice explaining your thought process when tackling testing challenges, especially those related to AI systems and Python frameworks.
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, it shows you're genuinely interested in joining the EPAM team and contributing to exciting projects.
We think you need these skills to ace Python QA Automation Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your Python programming skills and experience with test automation. We want to see how your background aligns with the role, so don’t be shy about showcasing relevant projects or achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re excited about the Python QA Automation Engineer position and how your skills can contribute to our AI-driven projects. Keep it engaging and personal!
Showcase Your Technical Skills:When filling out your application, be specific about your experience with tools like Pytest and any BDD frameworks you've used. We love seeing concrete examples of how you've tackled challenges in previous roles!
Apply Through Our Website:We encourage you to apply directly through our website for the best chance of getting noticed. It’s super easy, and you’ll be one step closer to joining our awesome team at EPAM!
How to prepare for a job interview at EPAM Systems, Inc.
✨Know Your Python Inside Out
Make sure you brush up on your Python skills, especially in the context of test automation. Be ready to discuss how you've used Python in previous projects, particularly with frameworks like Pytest and BDD tools. They’ll want to see your coding prowess, so practice writing clean, efficient code.
✨Familiarise Yourself with AI Testing
Since this role involves testing AI systems, get to grips with common issues like hallucination and tool misuse. Understand LLM evaluation approaches and be prepared to discuss how you would tackle these challenges in a real-world scenario. Showing that you can think critically about AI workflows will set you apart.
✨Embrace Agile Methodologies
This position is rooted in Agile practices, so be ready to talk about your experience in Agile environments. Share examples of how you've contributed to sprints, collaborated with cross-functional teams, and maintained quality metrics. Highlighting your adaptability and teamwork will resonate well.
✨Prepare Questions About the Role
Interviews are a two-way street, so come armed with thoughtful questions about the team, the project, and their expectations. This shows your genuine interest in the role and helps you gauge if it’s the right fit for you. Ask about their approach to quality assurance in AI and how they measure success.
