At a Glance
- Tasks: Develop automated testing frameworks and ensure quality for AI-driven enterprise projects.
- Company: Join EPAM, a leader in innovative tech solutions.
- Benefits: Enjoy competitive salary, health insurance, and perks like free lunches and social events.
- Other info: Dynamic Agile environment with excellent learning and career growth opportunities.
- Why this job: Be part of transformative AI projects and shape the future of technology.
- Qualifications: Strong Python skills and experience with automated testing frameworks required.
The predicted salary is between 50000 - 70000 € per year.
We're looking for a Quality Engineer to join EPAM in London, in an onsite working mode, contributing to an AI-driven enterprise project for one of our clients. This role focuses on exposing internal enterprise tooling to AI agents via Model Context Protocol (MCP), ensuring robust quality engineering and compliance across innovative intelligent automation solutions.
As a Quality Engineer, you will be responsible for developing automated testing frameworks, evaluation pipelines, and quality controls for MCP Components within our AI platform. You will work closely with engineering and product teams in a Classic Agile environment to guarantee the reliability, accuracy, and performance of agent-driven workflows operating in enterprise-scale systems. This position offers a chance to define standards for testing AI models and tools in production-like environments while being a critical part of one of EPAM’s most transformative projects.
Responsibilities
- Develop automated testing frameworks to validate MCP Servers and related AI systems
- Design and implement evaluation strategies for LLM accuracy, safety, and reliability
- Create automated tests using Python, Pytest, and BDD frameworks
- Build quality gates into CI/CD pipelines to maintain continuous assurance
- Identify and address agentic AI failure modes such as hallucination, latency, and incorrect tool usage
- Collaborate with engineering, QA, and product teams to define quality metrics and acceptance criteria
- Contribute to Agile ceremonies, ensuring testing practices align with sprint goals
- Prepare detailed reporting on quality outcomes and improvement opportunities
- Maintain documentation for test cases, evaluation pipelines, and validation strategies
Requirements
- Strong programming experience in Python applied to test automation and evaluation
- Expertise in Pytest and familiarity with BDD frameworks such as Behave or Cucumber
- Knowledge of LLM evaluation approaches including RAGAS, DeepEval, or custom pipelines
- Understanding of common agentic AI issues such as hallucination, tool misuse, and performance bottlenecks
- Familiarity with automated testing of AI workflows, distributed systems, or microservices environments
- Strong grasp of Agile delivery methodologies and CI/CD integration for quality checks
- Excellent communication and problem-solving skills with a focus on accuracy and reliability
Nice to have
- Experience with Model Context Protocol (MCP) or other agent orchestration solutions
- Exposure to observability, monitoring, or logging tools for AI systems
- API and service integration testing background for multi-layered platforms
- Knowledge of containerized environments and cloud-native architecture
- Background in enterprise AI automation projects or intelligent platform engineering
We offer
- EPAM Employee Stock Purchase Plan (ESPP)
- Protection benefits including life assurance, income protection and critical illness cover
- Private medical insurance and dental care
- Employee Assistance Program
- Competitive group pension plan
- Cyclescheme, Techscheme and season ticket loans
- Various perks such as free Wednesday lunch in-office, on-site massages and regular social events
- Learning and development opportunities including in-house training and coaching, professional certifications, and courses
- If otherwise eligible, participation in the discretionary annual bonus program
- If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program
Quality Engineer employer: EPAM Systems, Inc.
EPAM is an exceptional employer, offering a dynamic work environment in London where Quality Engineers can thrive on cutting-edge AI projects. With a strong focus on employee growth through in-house training, professional certifications, and a supportive culture that values collaboration and innovation, EPAM ensures that its team members are well-equipped to excel in their roles. Additionally, the company provides attractive benefits such as private medical insurance, competitive pension plans, and unique perks like free lunches and on-site massages, making it a rewarding place to build a meaningful career.
StudySmarter Expert Advice🤫
We think this is how you could land Quality Engineer
✨Tip Number 1
Network like a pro! Reach out to current employees at EPAM on LinkedIn or attend industry meetups. A friendly chat can give you insider info and maybe even a referral!
✨Tip Number 2
Prepare for the interview by brushing up on your Python skills and understanding automated testing frameworks. Be ready to discuss how you've tackled quality issues in past projects.
✨Tip Number 3
Showcase your problem-solving skills! During interviews, share specific examples of how you've identified and resolved agentic AI issues. This will highlight your expertise and fit for the role.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, it shows you're serious about joining the EPAM team.
We think you need these skills to ace Quality Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Quality Engineer role. Highlight your experience with Python, automated testing frameworks, and any relevant projects that showcase your skills in AI systems. We want to see how you fit into our team!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about quality engineering and how your background aligns with our AI-driven projects. Keep it engaging and personal – we love a good story!
Showcase Your Technical Skills:Don’t forget to mention your expertise in Pytest and any familiarity with BDD frameworks. If you've worked on LLM evaluation or have experience with CI/CD pipelines, make sure to highlight that. We’re looking for those specific skills!
Apply Through Our Website:We encourage you to apply through our website for the best chance of getting noticed. It’s super easy, and you’ll be able to keep track of your application status. Plus, we love seeing applications come directly from our site!
How to prepare for a job interview at EPAM Systems, Inc.
✨Know Your Tech Inside Out
Make sure you brush up on your Python skills, especially in test automation. Familiarise yourself with Pytest and BDD frameworks like Behave or Cucumber. Being able to discuss your experience with these tools confidently will show that you're ready to hit the ground running.
✨Understand AI Challenges
Get a good grasp of common issues in agentic AI, such as hallucination and tool misuse. Be prepared to discuss how you've tackled these problems in the past or how you would approach them. This shows that you’re not just technically savvy but also aware of the real-world implications of your work.
✨Show Your Agile Spirit
Since this role involves working in a Classic Agile environment, be ready to talk about your experience with Agile methodologies. Share examples of how you've contributed to Agile ceremonies and how you ensure testing aligns with sprint goals. This will demonstrate your ability to work collaboratively within a team.
✨Prepare for Quality Metrics Discussion
Think about quality metrics and acceptance criteria you've defined in previous roles. Be ready to discuss how you’ve built quality gates into CI/CD pipelines and maintained continuous assurance. This will highlight your proactive approach to quality engineering and your understanding of the importance of metrics in AI projects.
