Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Design and implement testing frameworks for cutting-edge AI tools and ensure their reliability.
- Company: Join a leading tech firm at the forefront of AI innovation.
- Benefits: Competitive daily rate, flexible working arrangements, and a chance to work on groundbreaking projects.
- Other info: Exciting contract role with opportunities for professional growth in a dynamic environment.
- Why this job: Make a real impact in AI quality assurance and shape the future of technology.
- Qualifications: Strong Python skills and experience in test automation and AI systems.
The predicted salary is between 54000 - 54000 £ per year.
This programme delivers a production-grade enterprise agentic AI platform, with MCP acting as the extensibility layer.
Responsibilities:
- Design and implement evaluation frameworks for MCP tools and Skills, covering correctness, safety, reliability, and regression performance.
- Build automated testing pipelines for agentic behaviours, including multi-step workflows and tool-calling interactions.
- Identify and mitigate AI failure modes such as hallucination, incorrect tool usage, invalid inputs, and latency amplification.
- Produce and maintain formal testing evidence required for internal release approvals (build and operate gates).
- Collaborate with ML Engineers to integrate test hooks and observability directly into MCP servers and Skills.
- Contribute to defining long-term quality assurance standards, testing practices, and governance models for a federated MCP ecosystem.
Skills & Experience Required:
- Strong Python experience for building test frameworks, automation tooling, and validation pipelines.
- Experience with LLM evaluation approaches, RAG evaluation frameworks, or custom model assessment systems.
- Hands-on experience in test automation across unit, integration, and regression testing.
- Understanding of agentic AI systems and their failure modes, particularly in non-deterministic environments.
- Ability to assess systems against governance, security, and audit/compliance requirements.
- Experience working within regulated or highly controlled engineering environments.
Quality Engineer in City of London employer: Cititec
Contact Detail:
Cititec Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Quality Engineer in City of London
✨Tip Number 1
Network like a pro! Reach out to folks in the tech industry, especially those working with AI and quality engineering. Attend meetups or webinars, and don’t be shy about sliding into DMs on LinkedIn. You never know who might have the inside scoop on job openings!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your Python projects, automated testing frameworks, or any relevant work you've done. This is your chance to demonstrate your hands-on experience and understanding of agentic AI systems. Make it easy for potential employers to see what you can bring to the table.
✨Tip Number 3
Prepare for interviews by brushing up on common quality engineering scenarios. Think about how you would tackle AI failure modes or design evaluation frameworks. Practise explaining your thought process clearly and confidently. Remember, they want to see how you think, not just what you know!
✨Tip Number 4
Don’t forget to apply through our website! We’ve got some fantastic opportunities that might just be the perfect fit for you. Plus, applying directly shows your enthusiasm and commitment. So, get your application in and let’s get you that Quality Engineer role!
We think you need these skills to ace Quality Engineer in City of London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Quality Engineer role. Highlight your Python experience and any relevant projects that showcase your skills in building test frameworks and automation tooling. We want to see how your background aligns with our needs!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about quality engineering and how your experience with AI systems can contribute to our team. Keep it concise but impactful – we love a good story!
Showcase Relevant Experience: When detailing your experience, focus on specific projects where you've implemented evaluation frameworks or automated testing pipelines. We’re keen to see how you’ve tackled challenges in regulated environments, so don’t hold back!
Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any important updates. Plus, it’s super easy!
How to prepare for a job interview at Cititec
✨Know Your Tech Inside Out
Make sure you brush up on your Python skills, especially in building test frameworks and automation tooling. Be ready to discuss specific projects where you've implemented these skills, as well as any experience with LLM evaluation approaches or custom model assessments.
✨Understand the Role of AI Systems
Familiarise yourself with agentic AI systems and their potential failure modes. Prepare to talk about how you've identified and mitigated issues like hallucination or incorrect tool usage in past projects. This shows you understand the complexities of the role.
✨Showcase Your Testing Experience
Be ready to discuss your hands-on experience with test automation across unit, integration, and regression testing. Highlight specific examples where your testing frameworks improved reliability or performance, as this will resonate well with the interviewers.
✨Collaboration is Key
Since the role involves working closely with ML Engineers, think of examples where you've successfully collaborated in a team setting. Discuss how you’ve integrated testing practices into development processes and contributed to quality assurance standards.