At a Glance
- Tasks: Design and execute automated testing for cutting-edge AI platforms.
- Company: Join a forward-thinking tech company focused on AI safety and compliance.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Dynamic team environment with a focus on innovation and career advancement.
- Why this job: Be at the forefront of AI security and make a real difference in technology.
- Qualifications: Experience in regulated finance and strong Python development skills required.
The predicted salary is between 80000 - 100000 € per year.
We are seeking a Lead AI Red Teaming & QA Engineer to design and execute automated adversarial testing for our enterprise Agentic AI platforms. You will move beyond traditional software QA to build continuous safety pipelines, ensuring our non-deterministic LLM agents, RAG systems, and tool integrations are secure, resilient, and compliant before production release.
Key Responsibilities
- Automated Adversarial Testing: Build and integrate automated red teaming suites into CI/CD pipelines using frameworks like Garak, Pyrit, and AgentDojo to enforce strict safety release gates.
- AI Evaluation Frameworks: Develop metrics and continuous testing for core AI risks, including hallucinations, memorisation, algorithmic bias, uncertainty, and model drift.
- Regulatory Compliance Evidence: Map threat models (OWASP LLM Top 10, Agentic threats) to automated test cases. Produce the technical testing evidence required by EU AI Act Article 15, DORA, and FCA Operational Resilience guidelines.
- Centralised AI-BOM Platform: Own the enterprise AI Bill of Materials (AI-BOM), tracking model lineages, dataset versions, and signed artifacts as a centralized evaluation service.
Required Technical Skills
- Regulated Finance: Proven experience testing software within FCA, DORA, or EU AI Act frameworks.
- AWS Bedrock Ecosystem: Hands-on experience configuring, testing, and bypassing Bedrock Guardrails, Agents, and Knowledge Bases (RAG).
- AI Security & Fundamentals: Solid understanding of Foundation Models, tool use (function calling), OWASP LLM Top 10, and NIST AI RMF.
- Automation Stack: Strong Python development skills, experience with AI eval tools (Garak, Pyrit, Ragas), and building complex CI/CD test pipelines.
Lead AI Red Teaming & QA Engineer in London employer: Randstad Technologies
At Randstad Technologies, we pride ourselves on fostering a dynamic and inclusive work environment that encourages innovation and professional growth. As a Lead AI Red Teaming & QA Engineer, you will have the opportunity to work at the forefront of AI technology in a collaborative setting, with access to cutting-edge tools and frameworks. Our commitment to employee development, coupled with a focus on regulatory compliance and safety, makes us an exceptional employer for those seeking meaningful and rewarding careers in the tech industry.
StudySmarter Expert Advice🤫
We think this is how you could land Lead AI Red Teaming & QA Engineer in London
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio or GitHub repository showcasing your projects related to AI red teaming and QA. This gives potential employers a taste of what you can do beyond just a CV.
✨Tip Number 3
Prepare for interviews by brushing up on the latest trends in AI security and compliance. Be ready to discuss how you would tackle specific challenges mentioned in the job description, like automated adversarial testing.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search.
We think you need these skills to ace Lead AI Red Teaming & QA Engineer in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights the skills and experiences that match the job description. We want to see how your background in automated adversarial testing and AI security aligns with what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about AI Red Teaming and how you can contribute to our mission at StudySmarter. Keep it engaging and relevant to the role.
Showcase Your Technical Skills:Don’t forget to mention your hands-on experience with tools like Garak, Pyrit, and AWS Bedrock. We love seeing specific examples of how you've used these in past projects, so be detailed!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team!
How to prepare for a job interview at Randstad Technologies
✨Know Your Tech Inside Out
Make sure you’re well-versed in the tools and frameworks mentioned in the job description, like Garak, Pyrit, and AgentDojo. Brush up on your Python skills and be ready to discuss how you've used these technologies in past projects.
✨Understand Regulatory Compliance
Familiarise yourself with the EU AI Act, FCA, and DORA guidelines. Be prepared to explain how you’ve ensured compliance in previous roles, and think of examples where you mapped threat models to automated test cases.
✨Showcase Your Problem-Solving Skills
During the interview, highlight specific challenges you’ve faced in automated adversarial testing and how you overcame them. Use the STAR method (Situation, Task, Action, Result) to structure your answers for clarity.
✨Ask Insightful Questions
Prepare thoughtful questions about the company’s approach to AI safety and testing. This shows your genuine interest in the role and helps you gauge if the company’s values align with yours.
