At a Glance
- Tasks: Build and maintain Python automation frameworks for AI-driven systems.
- Company: Innovative tech firm in London focusing on AI and automation.
- Benefits: Hybrid working, competitive salary, and opportunities for professional growth.
- Other info: Dynamic work environment with a focus on Agile methodologies.
- Why this job: Join a cutting-edge team ensuring the quality of AI technologies.
- Qualifications: Strong Python skills and experience with test automation frameworks.
The predicted salary is between 60000 - 80000 £ per year.
We need a Python QA Automation Engineer to assure quality, reliability, and compliance of AI‑driven enterprise systems exposing internal tooling to AI agents via Model Context Protocol (MCP).
Key Responsibilities:
- Build and maintain Python‑based automation frameworks to test MCP servers and AI workflows
- Design evaluation pipelines for LLM accuracy, safety, latency, and reliability
- Implement automated tests using Pytest and BDD frameworks
- Integrate quality gates into CI/CD pipelines for continuous assurance
- Detect and mitigate agentic AI failure modes such as hallucinations and incorrect tool usage
- Define quality metrics and acceptance criteria with engineering and product teams
- Contribute to Agile ceremonies within a Classic Agile delivery model
- Produce detailed quality reports and maintain test and validation documentation
Must‑Have Skills:
- Strong Python experience in test automation
- Advanced Pytest usage and BDD framework knowledge (Behave/Cucumber)
- Hands‑on LLM evaluation experience (RAGAS, DeepEval, or custom frameworks)
- Understanding of agentic AI risks and performance bottlenecks
- CI/CD integration for automated quality checks in distributed systems
- Experience with Model Context Protocol (MCP) or agent orchestration tools
- AI observability, monitoring, or logging exposure
- API and microservices testing experience
- Containerised or cloud‑native platform knowledge
Quality Assurance Automation Engineer employer: Airswift
As a leading innovator in AI-driven enterprise systems, we offer our Quality Assurance Automation Engineers a dynamic work environment in London that fosters collaboration and creativity. Our hybrid working model promotes a healthy work-life balance, while our commitment to employee growth through continuous learning and development ensures that you will thrive in your career. Join us to be part of a forward-thinking team that values quality, reliability, and the pursuit of excellence in technology.
StudySmarter Expert Advice🤫
We think this is how you could land Quality Assurance Automation Engineer
✨Tip Number 1
Network like a pro! Reach out to folks in the industry on LinkedIn or at meetups. We all know that sometimes it’s not just what you know, but who you know that can help you land that dream job.
✨Tip Number 2
Show off your skills! Create a GitHub repository showcasing your Python automation projects. We love seeing practical examples of your work, and it gives you a chance to demonstrate your expertise in QA automation.
✨Tip Number 3
Prepare for interviews by practising common QA scenarios and coding challenges. We recommend using platforms like LeetCode or HackerRank to sharpen your skills. The more prepared you are, the more confident you'll feel!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we’re always on the lookout for passionate candidates who want to make a difference in AI-driven systems.
We think you need these skills to ace Quality Assurance Automation Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your Python experience and any relevant automation frameworks you've worked with. We want to see how your skills align with the role, so don’t be shy about showcasing your achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about quality assurance in AI systems and how your background makes you a perfect fit for our team. Keep it engaging and personal.
Showcase Relevant Projects:If you've worked on projects involving LLM evaluation or CI/CD integration, make sure to mention them! We love seeing real-world applications of your skills, so include links or descriptions of your work.
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it’s super easy!
How to prepare for a job interview at Airswift
✨Know Your Python Inside Out
Make sure you brush up on your Python skills, especially in test automation. Be ready to discuss your experience with Pytest and BDD frameworks like Behave or Cucumber. Prepare examples of how you've built and maintained automation frameworks in the past.
✨Familiarise Yourself with AI and Agentic Systems
Since the role involves working with AI-driven systems, it’s crucial to understand agentic AI risks and performance bottlenecks. Research common failure modes, such as hallucinations, and be prepared to discuss how you would detect and mitigate these issues.
✨Showcase Your CI/CD Knowledge
The job requires integrating quality gates into CI/CD pipelines, so be ready to talk about your experience with continuous integration and deployment. Highlight any specific tools or processes you've used to ensure automated quality checks in distributed systems.
✨Prepare for Agile Discussions
As this role involves contributing to Agile ceremonies, brush up on Agile methodologies. Be prepared to share your experiences working in Agile teams and how you’ve contributed to delivering quality software in a Classic Agile delivery model.
