At a Glance
- Tasks: Design automated testing strategies for cutting-edge AI systems and validate their performance.
- Company: Join a leading financial services organisation revolutionising AI technology.
- Benefits: Competitive daily rate, hybrid working model, and opportunity to work on innovative projects.
- Other info: 6-month contract with excellent career growth potential.
- Why this job: Make a real impact in the AI space while ensuring quality and security.
- Qualifications: Experience in large-scale test automation and AI system validation required.
The predicted salary is between 156000 - 156000 € per year.
We’re supporting a financial services organisation building an enterprise AI platform and are looking for an AI QA Engineer to help define how large scale automated testing operates across a RAG-enabled ecosystem and help ensure their AI platforms are accurate, secure and production ready.
You’ll be responsible for validating LLM and RAG-based AI systems, building automated testing approaches around AI behaviours and helping define how AI quality, hallucinations, security and observability are measured at scale.
What you’ll be doing:
- Designing automated testing strategies for AI/LLM systems
- Validating RAG pipelines and retrieval accuracy
- Building frameworks to test AI quality, consistency and performance
- Measuring and assessing hallucinations and model behaviour
- Testing AI security boundaries, permissions and access controls
- Supporting observability and reporting through Datadog dashboards
- Working with engineering teams to define AI quality standards
- Testing agentic workflows and integrations including MCP environments
What they’re looking for:
- Strong background in large-scale test automation/QA engineering
- Previous experience testing AI systems, LLMs or GenAI applications
- Experience validating RAG architectures
- Knowledge of hallucination testing/evaluation frameworks
- Exposure to AWS Bedrock and Python
- Understanding of AI security, access controls and governance
- Familiarity with observability tooling (Datadog ideal)
- Bonus: MCP/agent frameworks experience
This is a 6-month contract paying £650 a day (inside IR35/umbrella rate). The client operate a hybrid working model and you will be expected to work 3 days a week in their London-based office.
QA Engineer (AI) - Contract - Financial Services in Slough employer: Vertus Partners
Join a forward-thinking financial services organisation that prioritises innovation and quality in the rapidly evolving AI landscape. As a QA Engineer, you'll thrive in a collaborative work culture that values your expertise while offering opportunities for professional growth and development. With a hybrid working model based in London, you can enjoy the benefits of flexible working arrangements alongside the dynamic energy of the city.
StudySmarter Expert Advice🤫
We think this is how you could land QA Engineer (AI) - Contract - Financial Services in Slough
✨Tip Number 1
Network like a pro! Reach out to folks in the financial services and AI sectors on LinkedIn. Join relevant groups and participate in discussions. You never know who might have a lead on that perfect QA Engineer role!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your previous work with AI systems and automated testing. This can really set you apart from other candidates and give potential employers a taste of what you can do.
✨Tip Number 3
Prepare for interviews by brushing up on common QA scenarios, especially those related to AI and LLMs. Practice articulating your experience with RAG architectures and hallucination testing. Confidence is key!
✨Tip Number 4
Don’t forget to apply through our website! We’ve got loads of opportunities that might be just right for you. Plus, it’s a great way to get noticed by our hiring team directly.
We think you need these skills to ace QA Engineer (AI) - Contract - Financial Services in Slough
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with large-scale test automation and AI systems. We want to see how your skills align with the role, so don’t be shy about showcasing relevant projects or achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about AI QA engineering and how your background makes you a perfect fit for our team. Keep it concise but impactful!
Showcase Your Technical Skills:Don’t forget to mention your experience with tools like AWS Bedrock, Python, and Datadog. We’re looking for someone who can hit the ground running, so highlight any relevant technical expertise that sets you apart.
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity in our financial services project!
How to prepare for a job interview at Vertus Partners
✨Know Your AI Inside Out
Make sure you brush up on your knowledge of AI systems, especially LLMs and RAG architectures. Be ready to discuss your previous experiences with testing these technologies and how you've approached challenges like hallucination testing.
✨Showcase Your Automation Skills
Prepare to talk about your experience in designing automated testing strategies. Bring examples of frameworks you've built or contributed to, and be ready to explain how they improved testing efficiency and accuracy in past projects.
✨Familiarise Yourself with Tools
Since the role involves observability tooling like Datadog, make sure you know how to use it. If you have experience with AWS Bedrock or Python, highlight that too. Being able to discuss these tools will show you're well-prepared for the technical aspects of the job.
✨Understand Security and Governance
AI security is a big deal, so be prepared to discuss access controls and governance. Think about how you've ensured security in previous roles and be ready to share specific examples that demonstrate your understanding of these critical areas.
