At a Glance
- Tasks: Lead the charge in building a safe AI ecosystem with cutting-edge technology.
- Company: Join a forward-thinking company focused on AI safety and compliance.
- Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
- Other info: Dynamic role with a focus on regulatory compliance and AI advancements.
- Why this job: Make a real difference in AI safety while working with innovative tech.
- Qualifications: Experience in UK Financial Services and expertise in automated testing required.
The predicted salary is between 80000 - 100000 £ per year.
Build and scale the "Safety & Trust" engine for our agentic AI ecosystem. You will be the technical lead responsible for ensuring our AWS Bedrock-based agents meet the highest standards of FCA Operational Resilience, DORA, and EU AI Act (Art. 15) compliance.
Core Responsibilities
- Automated Red Teaming: Implement adversarial testing (Garak, Pyrit, AgentDojo) directly into CI/CD pipelines with automated release gating.
- Centralised Eval Platform: Operate a firm-wide service to measure success rates, uncertainty, hallucination, and bias across all non-deterministic systems.
- Secure Architecture: Map OWASP LLM Top 10 and agentic threats to technical controls; manage AWS Bedrock Guardrails and Knowledge Bases.
- AI Supply Chain: Own the AI-BOM, ensuring supply chain integrity, signed artifacts, and drift monitoring.
- Regulatory Evidence: Produce the technical documentation and robust testing evidence required for EU AI Act Article 15.
Technical Requirements
- AWS Bedrock Expert: Hands-on experience with Bedrock Agents, Knowledge Bases, and model lifecycle management.
- AI/ML Depth: Strong grasp of FMs, RAG, tool-use, and the failure modes of agentic workflows.
- Security & Compliance: Deep knowledge of NIST AI RMF, OWASP LLM Top 10, and UK/EU financial regulations (FCA/DORA).
- Testing Automation: Proven ability to build measurement frameworks for drift, memorization, and adversarial robustness.
Qualifications
- Significant experience in UK Financial Services.
- Expertise in automated adversarial testing and evaluation at scale.
- Ability to bridge the gap between complex AI engineering and rigid regulatory requirements.
AI Red Teaming Specialist. Job in London LilyLifestyle Jobs employer: United Cerebral Palsy of Georgia
At LilyLifestyle, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration in the heart of London. Our commitment to employee growth is evident through continuous learning opportunities and a supportive environment that encourages creativity and technical excellence. Join us to be part of a forward-thinking team dedicated to building a safer AI ecosystem while enjoying the unique advantages of working in one of the world's most vibrant cities.
Contact Details:
United Cerebral Palsy of Georgia Recruitment Team
StudySmarter Expert Advice🤫
We think this is how you could land AI Red Teaming Specialist. Job in London LilyLifestyle Jobs
✨Tip Number 1
Network like a pro! Connect with folks in the AI and financial services sectors on LinkedIn. Join relevant groups, attend meetups, and don’t be shy about reaching out to people who work at companies you’re interested in. A friendly chat can open doors!
✨Tip Number 2
Show off your skills! Create a portfolio or GitHub repository showcasing your projects related to automated red teaming and AWS Bedrock. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on the latest trends in AI compliance and security. Be ready to discuss how you would tackle challenges like adversarial testing and regulatory requirements. Confidence and knowledge go a long way!
✨Tip Number 4
Don’t forget to apply through our website! We’ve got loads of opportunities that might just be the perfect fit for you. Plus, it’s a great way to ensure your application gets seen by the right people.
We think you need these skills to ace AI Red Teaming Specialist. Job in London LilyLifestyle Jobs
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with AWS Bedrock and automated adversarial testing. We want to see how your skills align with our needs, so don’t be shy about showcasing relevant projects!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about AI safety and compliance. We love seeing candidates who can connect their personal motivations to our mission.
Showcase Your Technical Skills:When detailing your technical expertise, be specific! Mention the tools and frameworks you’ve used, like Garak or Pyrit, and how you’ve implemented them in CI/CD pipelines. We’re looking for hands-on experience!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it’s super easy!
How to prepare for a job interview at United Cerebral Palsy of Georgia
✨Know Your Stuff
Make sure you brush up on your knowledge of AWS Bedrock and the specific tools mentioned in the job description, like Garak and Pyrit. Being able to discuss your hands-on experience with these technologies will show that you're not just familiar with them, but that you can actually implement them effectively.
✨Understand Compliance Inside Out
Since this role involves a lot of regulatory compliance, it’s crucial to have a solid grasp of FCA Operational Resilience, DORA, and the EU AI Act. Prepare to discuss how you've navigated these regulations in past roles and be ready to provide examples of how you ensured compliance in your projects.
✨Showcase Your Problem-Solving Skills
Be prepared to talk about specific challenges you've faced in automated adversarial testing or security compliance. Use the STAR method (Situation, Task, Action, Result) to structure your answers, highlighting how you approached problems and what the outcomes were.
✨Ask Insightful Questions
Interviews are a two-way street, so come armed with questions that show your interest in the company and the role. Ask about their current challenges with AI safety and trust, or how they measure success in their AI initiatives. This not only demonstrates your enthusiasm but also helps you gauge if the company is the right fit for you.
