At a Glance
- Tasks: Lead automated adversarial testing for cutting-edge AI platforms and ensure their security.
- Company: Join a forward-thinking tech company focused on AI innovation.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Dynamic role with potential for significant career advancement.
- Why this job: Be at the forefront of AI safety and compliance, making a real difference.
- Qualifications: Experience in regulated finance and strong Python skills required.
The predicted salary is between 80000 - 100000 € per year.
We are seeking a Lead AI Red Teaming & QA Engineer to design and execute automated adversarial testing for our enterprise Agentic AI platforms. You will move beyond traditional software QA to build continuous safety pipelines, ensuring our non-deterministic LLM agents, RAG systems, and tool integrations are secure, resilient, and compliant before production release.
Key Responsibilities
- Automated Adversarial Testing: Build and integrate automated red teaming suites into CI/CD pipelines using frameworks like Garak, Pyrit, and AgentDojo to enforce strict safety release gates.
- AI Evaluation Frameworks: Develop metrics and continuous testing for core AI risks, including hallucinations, memorisation, algorithmic bias, uncertainty, and model drift.
- Regulatory Compliance Evidence: Map threat models (OWASP LLM Top 10, Agentic threats) to automated test cases. Produce the technical testing evidence required by EU AI Act Article 15, DORA, and FCA Operational Resilience guidelines.
- Centralised AI-BOM Platform: Own the enterprise AI Bill of Materials (AI-BOM), tracking model lineages, dataset versions, and signed artifacts as a centralized evaluation service.
Required Technical Skills
- Regulated Finance: Proven experience testing software within FCA, DORA, or EU AI Act frameworks.
- AWS Bedrock Ecosystem: Hands-on experience configuring, testing, and bypassing Bedrock Guardrails, Agents, and Knowledge Bases (RAG).
- AI Security & Fundamentals: Solid understanding of Foundation Models, tool use (function calling), OWASP LLM Top 10, and NIST AI RMF.
- Automation Stack: Strong Python development skills, experience with AI eval tools (Garak, Pyrit, Ragas), and building complex CI/CD test pipelines.
Lead AI Red Teaming & QA Engineer in City of London employer: Randstad Technologies Recruitment
At Randstad Technologies, we pride ourselves on fostering a dynamic and innovative work environment that empowers our employees to excel in their roles. As a Lead AI Red Teaming & QA Engineer, you will benefit from a culture of continuous learning and collaboration, with ample opportunities for professional growth and development in the rapidly evolving field of AI. Our commitment to regulatory compliance and cutting-edge technology ensures that you will be at the forefront of industry advancements while working in a supportive team that values your contributions.
Contact Detail:
Randstad Technologies Recruitment Recruiting Team
StudySmarter Expert Advice🤫
We think this is how you could land Lead AI Red Teaming & QA Engineer in City of London
✨Tip Number 1
Network like a pro! Reach out to folks in the AI and QA space on LinkedIn or at industry events. A friendly chat can open doors that a CV just can't.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your automated testing projects or any cool red teaming work you've done. It’s a great way to demonstrate your expertise beyond the usual application.
✨Tip Number 3
Prepare for interviews by brushing up on the latest trends in AI security and compliance. We want you to be ready to discuss how you’d tackle challenges like algorithmic bias or model drift.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive!
We think you need these skills to ace Lead AI Red Teaming & QA Engineer in City of London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV reflects the skills and experiences that match the job description. Highlight your experience with automated testing, AI security, and any relevant frameworks like FCA or DORA. We want to see how you fit into our world!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about AI Red Teaming and how your background makes you the perfect fit for this role. Let us know what excites you about working with our Agentic AI platforms.
Showcase Your Technical Skills:Don’t just list your technical skills; demonstrate them! If you've worked with tools like Garak or Pyrit, share specific examples of how you used them in past projects. We love seeing real-world applications of your expertise.
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows us you’re keen on joining the StudySmarter team!
How to prepare for a job interview at Randstad Technologies Recruitment
✨Know Your Tech Inside Out
Make sure you’re well-versed in the tools and frameworks mentioned in the job description, like Garak, Pyrit, and AgentDojo. Brush up on your Python skills and be ready to discuss how you've used these technologies in past projects.
✨Showcase Your Regulatory Knowledge
Since this role involves working within FCA, DORA, and EU AI Act frameworks, be prepared to talk about your experience with regulatory compliance. Bring examples of how you've mapped threat models to automated test cases in previous roles.
✨Demonstrate Problem-Solving Skills
Expect scenario-based questions where you’ll need to demonstrate your approach to adversarial testing and ensuring safety in AI systems. Think of specific challenges you've faced and how you overcame them, especially in relation to non-deterministic LLM agents.
✨Prepare Questions for Them
Interviews are a two-way street! Prepare insightful questions about their current projects, team dynamics, or future goals regarding AI safety. This shows your genuine interest in the role and helps you assess if it’s the right fit for you.
