At a Glance
- Tasks: Design and execute automated adversarial testing for cutting-edge AI platforms.
- Company: Join Randstad Technologies, a leader in innovative tech solutions.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Dynamic role with excellent career advancement potential in a fast-paced environment.
- Why this job: Be at the forefront of AI security and make a real difference in technology.
- Qualifications: Experience in regulated finance and strong Python development skills required.
The predicted salary is between 80000 - 100000 € per year.
We are seeking a Lead AI Red Teaming & QA Engineer to design and execute automated adversarial testing for our enterprise Agentic AI platforms. You will move beyond traditional software QA to build continuous safety pipelines, ensuring our non-deterministic LLM agents, RAG systems, and tool integrations are secure, resilient, and compliant before production release.
Key Responsibilities
- Automated Adversarial Testing: Build and integrate automated red teaming suites into CI/CD pipelines using frameworks like Garak, Pyrit, and AgentDojo to enforce strict safety release gates.
- AI Evaluation Frameworks: Develop metrics and continuous testing for core AI risks, including hallucinations, memorisation, algorithmic bias, uncertainty, and model drift.
- Regulatory Compliance Evidence: Map threat models (OWASP LLM Top 10, Agentic threats) to automated test cases. Produce the technical testing evidence required by EU AI Act Article 15, DORA, and FCA Operational Resilience guidelines.
- Centralised AI-BOM Platform: Own the enterprise AI Bill of Materials (AI-BOM), tracking model lineages, dataset versions, and signed artifacts as a centralized evaluation service.
Required Technical Skills
- Regulated Finance: Proven experience testing software within FCA, DORA, or EU AI Act frameworks.
- AWS Bedrock Ecosystem: Hands-on experience configuring, testing, and bypassing Bedrock Guardrails, Agents, and Knowledge Bases (RAG).
- AI Security & Fundamentals: Solid understanding of Foundation Models, tool use (function calling), OWASP LLM Top 10, and NIST AI RMF.
- Automation Stack: Strong Python development skills, experience with AI eval tools (Garak, Pyrit, Ragas), and building complex CI/CD test pipelines.
Lead AI Red Teaming & QA Engineer in London employer: Randstad Technologies Recruitment
At Randstad Technologies, we pride ourselves on fostering a dynamic and innovative work environment that empowers our employees to excel in their roles. As a Lead AI Red Teaming & QA Engineer, you will benefit from a culture of continuous learning and collaboration, with ample opportunities for professional growth and development in the rapidly evolving field of AI. Our commitment to regulatory compliance and cutting-edge technology ensures that you will be at the forefront of industry advancements while working in a supportive team that values your contributions.
Contact Detail:
Randstad Technologies Recruitment Recruiting Team
StudySmarter Expert Advice🤫
We think this is how you could land Lead AI Red Teaming & QA Engineer in London
✨Tip Number 1
Network like a pro! Reach out to folks in the AI and QA space on LinkedIn or at industry events. A friendly chat can open doors that a CV just can't.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your automated testing projects or any cool adversarial testing you've done. This is your chance to shine beyond the written application.
✨Tip Number 3
Prepare for interviews by brushing up on the latest trends in AI security and compliance. Be ready to discuss how you’d tackle challenges like algorithmic bias or model drift in real-world scenarios.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets the attention it deserves. Plus, we love seeing candidates who are proactive!
We think you need these skills to ace Lead AI Red Teaming & QA Engineer in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Lead AI Red Teaming & QA Engineer role. Highlight your experience with automated testing, CI/CD pipelines, and any relevant frameworks like Garak or Pyrit. We want to see how your skills align with our needs!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about AI security and how your background makes you the perfect fit for our team. Don’t forget to mention any experience with regulatory compliance, as it's super important for us.
Showcase Your Projects:If you've worked on any relevant projects, make sure to include them in your application. Whether it's building automated testing suites or working with AI evaluation frameworks, we love seeing real-world examples of your work!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it gives you a chance to explore more about what we do at StudySmarter!
How to prepare for a job interview at Randstad Technologies Recruitment
✨Know Your Tech Inside Out
Make sure you’re well-versed in the tools and frameworks mentioned in the job description, like Garak, Pyrit, and AgentDojo. Brush up on your Python skills and be ready to discuss how you've used these technologies in past projects.
✨Showcase Your Regulatory Knowledge
Since this role involves working within FCA, DORA, and EU AI Act frameworks, be prepared to talk about your experience with regulatory compliance. Bring examples of how you've mapped threat models to automated test cases in previous roles.
✨Demonstrate Problem-Solving Skills
Expect scenario-based questions where you’ll need to demonstrate your approach to adversarial testing and risk evaluation. Think of specific challenges you’ve faced and how you overcame them, especially in relation to AI security and model drift.
✨Prepare Questions That Matter
Interviews are a two-way street! Prepare insightful questions about the company’s approach to AI safety and how they integrate continuous testing into their pipelines. This shows your genuine interest and helps you assess if it’s the right fit for you.
