At a Glance
- Tasks: Develop automated testing frameworks and ensure quality for AI-driven enterprise projects.
- Company: Join EPAM, a leader in innovative tech solutions.
- Benefits: Enjoy competitive pay, health perks, and fun office vibes like free lunches and massages.
- Other info: Dynamic Agile environment with great learning and career growth opportunities.
- Why this job: Be part of transformative AI projects and shape the future of intelligent automation.
- Qualifications: Strong Python skills and experience with automated testing frameworks required.
The predicted salary is between 50000 - 70000 £ per year.
We're looking for a Quality Engineer to join EPAM in London, in an onsite working mode, contributing to an AI-driven enterprise project for one of our clients. This role focuses on exposing internal enterprise tooling to AI agents via Model Context Protocol (MCP), ensuring robust quality engineering and compliance across innovative intelligent automation solutions.
As a Quality Engineer, you will be responsible for developing automated testing frameworks, evaluation pipelines, and quality controls for MCP Components within our AI platform. You will work closely with engineering and product teams in a Classic Agile environment to guarantee the reliability, accuracy, and performance of agent-driven workflows operating in enterprise-scale systems. This position offers a chance to define standards for testing AI models and tools in production-like environments while being a critical part of one of EPAM’s most transformative projects.
Responsibilities- Develop automated testing frameworks to validate MCP Servers and related AI systems
- Design and implement evaluation strategies for LLM accuracy, safety, and reliability
- Create automated tests using Python, Pytest, and BDD frameworks
- Build quality gates into CI/CD pipelines to maintain continuous assurance
- Identify and address agentic AI failure modes such as hallucination, latency, and incorrect tool usage
- Collaborate with engineering, QA, and product teams to define quality metrics and acceptance criteria
- Contribute to Agile ceremonies, ensuring testing practices align with sprint goals
- Prepare detailed reporting on quality outcomes and improvement opportunities
- Maintain documentation for test cases, evaluation pipelines, and validation strategies
- Strong programming experience in Python applied to test automation and evaluation
- Expertise in Pytest and familiarity with BDD frameworks such as Behave or Cucumber
- Knowledge of LLM evaluation approaches including RAGAS, DeepEval, or custom pipelines
- Understanding of common agentic AI issues such as hallucination, tool misuse, and performance bottlenecks
- Familiarity with automated testing of AI workflows, distributed systems, or microservices environments
- Strong grasp of Agile delivery methodologies and CI/CD integration for quality checks
- Excellent communication and problem-solving skills with a focus on accuracy and reliability
- Experience with Model Context Protocol (MCP) or other agent orchestration solutions
- Exposure to observability, monitoring, or logging tools for AI systems
- API and service integration testing background for multi-layered platforms
- Knowledge of containerized environments and cloud-native architecture
- Background in enterprise AI automation projects or intelligent platform engineering
- EPAM Employee Stock Purchase Plan (ESPP)
- Protection benefits including life assurance, income protection and critical illness cover
- Private medical insurance and dental care
- Employee Assistance Program
- Cyclescheme, Techscheme and season ticket loans
- Various perks such as free Wednesday lunch in-office, on-site massages and regular social events
- Learning and development opportunities including in-house training and coaching, professional certifications, and courses
- If otherwise eligible, participation in the discretionary annual bonus program
- If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program
Quality Engineer employer: EPAM Systems
EPAM is an exceptional employer, offering a dynamic work environment in London where Quality Engineers can thrive on innovative AI-driven projects. With a strong focus on employee growth through in-house training, professional certifications, and a vibrant work culture that includes perks like free lunches and social events, EPAM ensures that its team members are well-supported and engaged. The opportunity to work closely with engineering and product teams in a Classic Agile setting further enhances the collaborative spirit, making it a rewarding place for those seeking meaningful contributions in the tech industry.
StudySmarter Expert Advice🤫
We think this is how you could land Quality Engineer
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, especially those at EPAM. A friendly chat can sometimes lead to opportunities that aren’t even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio or GitHub repo showcasing your automated testing frameworks and any cool projects you've worked on. This gives potential employers a taste of what you can do.
✨Tip Number 3
Prepare for interviews by brushing up on Agile methodologies and quality metrics. Be ready to discuss how you’ve tackled agentic AI issues in the past – real examples go a long way!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search.
We think you need these skills to ace Quality Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Quality Engineer role. Highlight your experience with Python, automated testing frameworks, and any relevant Agile methodologies. We want to see how your skills align with our needs!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about quality engineering and how you can contribute to our AI-driven projects. Keep it engaging and relevant to the job description.
Showcase Your Projects:If you've worked on any projects related to AI, automated testing, or CI/CD pipelines, make sure to mention them. We love seeing real-world applications of your skills, so don’t hold back!
Apply Through Our Website:We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any important updates from us!
How to prepare for a job interview at EPAM Systems
✨Know Your Tech Inside Out
Make sure you brush up on your Python skills, especially in test automation. Familiarise yourself with Pytest and BDD frameworks like Behave or Cucumber. Being able to discuss your experience with these tools confidently will show that you're ready to hit the ground running.
✨Understand AI Evaluation Metrics
Dive deep into LLM evaluation approaches such as RAGAS and DeepEval. Be prepared to talk about common agentic AI issues like hallucination and tool misuse. This knowledge will demonstrate your expertise and commitment to quality engineering in AI-driven projects.
✨Show Your Agile Spirit
Since this role involves working in a Classic Agile environment, be ready to discuss your experience with Agile methodologies. Share examples of how you've contributed to Agile ceremonies and how you align testing practices with sprint goals. This will highlight your collaborative mindset.
✨Prepare Questions That Matter
Think of insightful questions to ask your interviewers about the project and team dynamics. Inquire about the challenges they face with AI systems or how they measure success in quality engineering. This shows your genuine interest in the role and helps you assess if it's the right fit for you.
