At a Glance
- Tasks: Lead the charge in ensuring AI safety and compliance through innovative testing and evaluation.
- Company: Join a forward-thinking company at the forefront of AI technology in London.
- Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
- Other info: Dynamic role with a focus on innovation and regulatory excellence.
- Why this job: Make a real difference in AI safety while working with cutting-edge technology.
- Qualifications: Experience in financial services and expertise in automated testing required.
The predicted salary is between 80000 - 100000 £ per year.
Build and scale the "Safety & Trust" engine for our agentic AI ecosystem. You will be the technical lead responsible for ensuring our AWS Bedrock-based agents meet the highest standards of FCA Operational Resilience, DORA, and EU AI Act (Art. 15) compliance.
Core Responsibilities
- Automated Red Teaming: Implement adversarial testing (Garak, Pyrit, AgentDojo) directly into CI/CD pipelines with automated release gating.
- Centralised Eval Platform: Operate a firm-wide service to measure success rates, uncertainty, hallucination, and bias across all non-deterministic systems.
- Secure Architecture: Map OWASP LLM Top 10 and agentic threats to technical controls; manage AWS Bedrock Guardrails and Knowledge Bases.
- AI Supply Chain: Own the AI-BOM, ensuring supply chain integrity, signed artifacts, and drift monitoring.
- Regulatory Evidence: Produce the technical documentation and robust testing evidence required for EU AI Act Article 15.
Technical Requirements
- AWS Bedrock Expert: Hands-on experience with Bedrock Agents, Knowledge Bases, and model lifecycle management.
- AI/ML Depth: Strong grasp of FMs, RAG, tool-use, and the failure modes of agentic workflows.
- Security & Compliance: Deep knowledge of NIST AI RMF, OWASP LLM Top 10, and UK/EU financial regulations (FCA/DORA).
- Testing Automation: Proven ability to build measurement frameworks for drift, memorization, and adversarial robustness.
Qualifications
- Significant experience in UK Financial Services.
- Expertise in automated adversarial testing and evaluation at scale.
- Ability to bridge the gap between complex AI engineering and rigid regulatory requirements.
AI Red Teaming Specialist. Job in London LilyLifestyle Jobs employer: United Cerebral Palsy of Georgia
At LilyLifestyle, we pride ourselves on being an exceptional employer, particularly for the role of AI Red Teaming Specialist in London. Our vibrant work culture fosters innovation and collaboration, providing employees with ample opportunities for professional growth and development in the rapidly evolving field of AI. With a strong commitment to compliance and operational resilience, we offer a unique environment where your expertise will directly contribute to shaping the future of AI safety and trust.
Contact Details:
United Cerebral Palsy of Georgia Recruitment Team
StudySmarter Expert Advice🤫
We think this is how you could land AI Red Teaming Specialist. Job in London LilyLifestyle Jobs
✨Tip Number 1
Network like a pro! Reach out to folks in the AI and financial services sectors on LinkedIn. Join relevant groups and engage in discussions. You never know who might have the inside scoop on job openings!
✨Tip Number 2
Show off your skills! Create a portfolio or GitHub repository showcasing your projects related to AWS Bedrock, automated testing, or compliance frameworks. This gives potential employers a taste of what you can do.
✨Tip Number 3
Prepare for interviews by brushing up on the latest trends in AI regulations and security compliance. Be ready to discuss how your experience aligns with the FCA and EU AI Act requirements. Confidence is key!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace AI Red Teaming Specialist. Job in London LilyLifestyle Jobs
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with AWS Bedrock and automated adversarial testing. We want to see how your skills align with our needs, so don’t be shy about showcasing relevant projects!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about AI safety and compliance. We love seeing candidates who can connect their personal motivations to our mission.
Showcase Your Technical Skills:When detailing your experience, focus on specific tools and frameworks you've used, like Garak or Pyrit. We’re looking for someone who can hit the ground running, so let us know what you bring to the table!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to keep track of your application and ensure it gets the attention it deserves. Plus, it’s super easy!
How to prepare for a job interview at United Cerebral Palsy of Georgia
✨Know Your Tech Inside Out
Make sure you’re well-versed in AWS Bedrock and the tools mentioned in the job description, like Garak and Pyrit. Brush up on your knowledge of adversarial testing and how it fits into CI/CD pipelines, as this will likely come up during the interview.
✨Understand Compliance Like a Pro
Familiarise yourself with FCA Operational Resilience, DORA, and the EU AI Act, especially Article 15. Be ready to discuss how you’ve navigated regulatory requirements in past roles and how you can ensure compliance in the AI ecosystem.
✨Showcase Your Problem-Solving Skills
Prepare examples of how you've tackled challenges related to security and compliance in AI/ML projects. Highlight your experience with building measurement frameworks for drift and adversarial robustness, as this will demonstrate your hands-on expertise.
✨Ask Insightful Questions
Come prepared with questions that show your interest in the company’s approach to AI safety and trust. Inquire about their current challenges with automated red teaming or how they measure success rates across their systems. This shows you’re not just interested in the role, but also in contributing to their mission.
