At a Glance
- Tasks: Design and implement testing frameworks for cutting-edge AI tools and ensure their reliability.
- Company: Join a leading tech company at the forefront of AI innovation.
- Benefits: Competitive daily rate, flexible working arrangements, and opportunities for professional growth.
- Other info: Dynamic contract role with potential for long-term impact in a fast-paced environment.
- Why this job: Be part of a transformative project that shapes the future of AI technology.
- Qualifications: Strong Python skills and experience in test automation and AI systems.
The predicted salary is between 54000 - 78000 £ per year.
This programme delivers a production-grade enterprise agentic AI platform, with MCP acting as the extensibility layer.
Responsibilities:
- Design and implement evaluation frameworks for MCP tools and Skills, covering correctness, safety, reliability, and regression performance.
- Build automated testing pipelines for agentic behaviours, including multi-step workflows and tool-calling interactions.
- Identify and mitigate AI failure modes such as hallucination, incorrect tool usage, invalid inputs, and latency amplification.
- Produce and maintain formal testing evidence required for internal release approvals (build and operate gates).
- Collaborate with ML Engineers to integrate test hooks and observability directly into MCP servers and Skills.
- Contribute to defining long-term quality assurance standards, testing practices, and governance models for a federated MCP ecosystem.
Skills & Experience Required:
- Strong Python experience for building test frameworks, automation tooling, and validation pipelines.
- Experience with LLM evaluation approaches, RAG evaluation frameworks, or custom model assessment systems.
- Hands-on experience in test automation across unit, integration, and regression testing.
- Understanding of agentic AI systems and their failure modes, particularly in non-deterministic environments.
- Ability to assess systems against governance, security, and audit/compliance requirements.
- Experience working within regulated or highly controlled engineering environments.
Quality Engineer employer: Cititec
Contact Detail:
Cititec Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Quality Engineer
✨Tip Number 1
Network like a pro! Reach out to folks in the tech industry, especially those working with AI and quality engineering. Attend meetups or webinars, and don’t be shy about sliding into DMs on LinkedIn. You never know who might have the inside scoop on job openings!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your Python projects, automated testing frameworks, or any relevant work you've done. This is your chance to demonstrate your hands-on experience and understanding of agentic AI systems. Make it easy for potential employers to see what you can bring to the table.
✨Tip Number 3
Prepare for interviews by brushing up on common quality engineering scenarios. Think about how you would tackle AI failure modes or build automated testing pipelines. Practise articulating your thought process clearly, as this will show your problem-solving skills and technical knowledge.
✨Tip Number 4
Don’t forget to apply through our website! We’ve got some fantastic opportunities that might just be the perfect fit for you. Plus, applying directly can sometimes give you a leg up in the hiring process. So, get your application in and let’s get you that Quality Engineer role!
We think you need these skills to ace Quality Engineer
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Quality Engineer role. Highlight your Python experience and any relevant projects that showcase your skills in building test frameworks and automation tooling. We want to see how your background aligns with our needs!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about quality assurance and how your experience with AI systems can contribute to our team. Keep it concise but impactful – we love a good story!
Showcase Relevant Experience: When detailing your experience, focus on specific projects where you've implemented evaluation frameworks or automated testing pipelines. We’re keen to see how you’ve tackled challenges in regulated environments, so don’t hold back!
Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any important updates. Plus, it’s super easy!
How to prepare for a job interview at Cititec
✨Know Your Tech Inside Out
Make sure you brush up on your Python skills and any relevant frameworks. Be ready to discuss how you've built test frameworks or automation tooling in the past. The more specific examples you can provide, the better!
✨Understand AI Failure Modes
Familiarise yourself with common failure modes in agentic AI systems. Be prepared to talk about how you've identified and mitigated issues like hallucination or incorrect tool usage in previous projects. This shows you know your stuff!
✨Showcase Your Testing Experience
Highlight your hands-on experience with unit, integration, and regression testing. Bring examples of automated testing pipelines you've built and how they improved the quality of the software. Concrete examples will make you stand out.
✨Collaboration is Key
Since you'll be working closely with ML Engineers, emphasise your teamwork skills. Share experiences where you've collaborated on integrating test hooks or improving observability in systems. This will demonstrate your ability to work in a regulated environment.