At a Glance
- Tasks: Lead the charge in building a safe and trustworthy AI ecosystem.
- Company: Join a forward-thinking company at the forefront of AI innovation.
- Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
- Other info: Dynamic role with a focus on compliance and security in AI.
- Why this job: Make a real difference in AI safety while working with cutting-edge technology.
- Qualifications: Experience in UK Financial Services and expertise in automated testing required.
The predicted salary is between 80000 - 100000 £ per year.
Build and scale the "Safety & Trust" engine for our agentic AI ecosystem. You will be the technical lead responsible for ensuring our AWS Bedrock-based agents meet the highest standards of FCA Operational Resilience, DORA, and EU AI Act (Art. 15) compliance.
Core Responsibilities
- Automated Red Teaming: Implement adversarial testing (Garak, Pyrit, AgentDojo) directly into CI/CD pipelines with automated release gating.
- Centralised Eval Platform: Operate a firm-wide service to measure success rates, uncertainty, hallucination, and bias across all non-deterministic systems.
- Secure Architecture: Map OWASP LLM Top 10 and agentic threats to technical controls; manage AWS Bedrock Guardrails and Knowledge Bases.
- AI Supply Chain: Own the AI-BOM, ensuring supply chain integrity, signed artifacts, and drift monitoring.
- Regulatory Evidence: Produce the technical documentation and robust testing evidence required for EU AI Act Article 15.
Technical Requirements
- AWS Bedrock Expert: Hands-on experience with Bedrock Agents, Knowledge Bases, and model lifecycle management.
- AI/ML Depth: Strong grasp of FMs, RAG, tool-use, and the failure modes of agentic workflows.
- Security & Compliance: Deep knowledge of NIST AI RMF, OWASP LLM Top 10, and UK/EU financial regulations (FCA/DORA).
- Testing Automation: Proven ability to build measurement frameworks for drift, memorization, and adversarial robustness.
Qualifications
- Significant experience in UK Financial Services.
- Expertise in automated adversarial testing and evaluation at scale.
- Ability to bridge the gap between complex AI engineering and rigid regulatory requirements.
Ai Red Teaming Expert. Job in London LilyLifestyle Jobs employer: United Cerebral Palsy of Georgia
At LilyLifestyle, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration in the heart of London. Our commitment to employee growth is evident through continuous learning opportunities and a supportive environment that encourages creativity and technical excellence. Join us to be part of a forward-thinking team dedicated to building a safe and trustworthy AI ecosystem, where your contributions will directly impact the future of technology and compliance.
Contact Details:
United Cerebral Palsy of Georgia Recruitment Team
StudySmarter Expert Advice🤫
We think this is how you could land Ai Red Teaming Expert. Job in London LilyLifestyle Jobs
✨Tip Number 1
Network like a pro! Get out there and connect with folks in the AI and financial services sectors. Attend meetups, webinars, or industry events to make those valuable connections that could lead to your next opportunity.
✨Tip Number 2
Show off your skills! Create a portfolio or GitHub repository showcasing your projects related to automated adversarial testing and AWS Bedrock. This gives potential employers a tangible look at what you can do.
✨Tip Number 3
Prepare for interviews by brushing up on your knowledge of compliance standards like FCA and DORA. Be ready to discuss how your experience aligns with these regulations and how you can contribute to building a secure architecture.
✨Tip Number 4
Don’t forget to apply through our website! We’re always on the lookout for talented individuals who can help us scale our 'Safety & Trust' engine. Your dream job might just be a click away!
We think you need these skills to ace Ai Red Teaming Expert. Job in London LilyLifestyle Jobs
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with AWS Bedrock and automated adversarial testing. We want to see how your skills align with our needs, so don’t be shy about showcasing relevant projects!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about AI safety and compliance. Let us know how your background in UK Financial Services makes you the perfect fit for this role.
Showcase Your Technical Skills:When filling out your application, be specific about your technical expertise. Mention any hands-on experience with tools like Garak or Pyrit, and how you've implemented them in CI/CD pipelines. We love details!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it’s super easy!
How to prepare for a job interview at United Cerebral Palsy of Georgia
✨Know Your Tech Inside Out
Make sure you’re well-versed in AWS Bedrock and the tools mentioned in the job description, like Garak and Pyrit. Brush up on your knowledge of adversarial testing and how it fits into CI/CD pipelines, as this will likely come up during the interview.
✨Understand Regulatory Frameworks
Familiarise yourself with the FCA Operational Resilience, DORA, and EU AI Act compliance requirements. Be prepared to discuss how your experience aligns with these regulations and how you can ensure compliance in your role.
✨Showcase Your Problem-Solving Skills
Prepare examples of how you've tackled challenges in automated testing or security compliance in the past. Highlight your ability to bridge complex AI engineering with regulatory needs, as this is a key aspect of the role.
✨Ask Insightful Questions
Come prepared with questions that show your interest in the company’s AI ecosystem and its safety measures. Inquire about their current challenges in automated red teaming or how they measure success rates across their systems to demonstrate your engagement.
