At a Glance
- Tasks: Lead the charge in building a safe and compliant AI ecosystem.
- Company: Join a forward-thinking tech company in the heart of London.
- Benefits: Competitive salary, flexible working hours, and opportunities for growth.
- Other info: Dynamic team environment with a focus on innovation and compliance.
- Why this job: Be at the forefront of AI safety and make a real difference.
- Qualifications: Experience in UK Financial Services and expertise in automated testing.
The predicted salary is between 80000 - 100000 £ per year.
Build and scale the "Safety & Trust" engine for our agentic AI ecosystem. You will be the technical lead responsible for ensuring our AWS Bedrock-based agents meet the highest standards of FCA Operational Resilience, DORA, and EU AI Act (Art. 15) compliance.
Core Responsibilities
- Automated Red Teaming: Implement adversarial testing (Garak, Pyrit, AgentDojo) directly into CI/CD pipelines with automated release gating.
- Centralised Eval Platform: Operate a firm-wide service to measure success rates, uncertainty, hallucination, and bias across all non-deterministic systems.
- Secure Architecture: Map OWASP LLM Top 10 and agentic threats to technical controls; manage AWS Bedrock Guardrails and Knowledge Bases.
- AI Supply Chain: Own the AI-BOM, ensuring supply chain integrity, signed artifacts, and drift monitoring.
- Regulatory Evidence: Produce the technical documentation and robust testing evidence required for EU AI Act Article 15.
Technical Requirements
- AWS Bedrock Expert: Hands-on experience with Bedrock Agents, Knowledge Bases, and model lifecycle management.
- AI/ML Depth: Strong grasp of FMs, RAG, tool-use, and the failure modes of agentic workflows.
- Security & Compliance: Deep knowledge of NIST AI RMF, OWASP LLM Top 10, and UK/EU financial regulations (FCA/DORA).
- Testing Automation: Proven ability to build measurement frameworks for drift, memorization, and adversarial robustness.
Qualifications
- Significant experience in UK Financial Services.
- Expertise in automated adversarial testing and evaluation at scale.
- Ability to bridge the gap between complex AI engineering and rigid regulatory requirements.
Ai Red Teaming Expert. Job in London LilyLifestyle Jobs employer: United Cerebral Palsy of Georgia
At LilyLifestyle, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration in the heart of London. Our commitment to employee growth is evident through continuous learning opportunities and a supportive environment that encourages creativity and technical excellence. Join us to be part of a forward-thinking team dedicated to building a safe and trustworthy AI ecosystem, where your contributions will directly impact the future of technology and compliance.
Contact Details:
United Cerebral Palsy of Georgia Recruitment Team
StudySmarter Expert Advice🤫
We think this is how you could land Ai Red Teaming Expert. Job in London LilyLifestyle Jobs
✨Tip Number 1
Network like a pro! Get out there and connect with folks in the AI and financial services sectors. Attend meetups, webinars, or even just grab a coffee with someone in the industry. You never know who might have the inside scoop on job openings!
✨Tip Number 2
Show off your skills! Create a portfolio or GitHub repository showcasing your projects related to AWS Bedrock, automated testing, or compliance frameworks. This gives potential employers a tangible look at what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by diving deep into the specifics of the role. Brush up on your knowledge of FCA regulations, OWASP LLM Top 10, and adversarial testing techniques. The more you know, the more confident you'll feel when discussing your expertise!
✨Tip Number 4
Don't forget to apply through our website! We make it easy for you to find roles that match your skills and interests. Plus, applying directly shows your enthusiasm for joining our team and helps us get to know you better right from the start.
We think you need these skills to ace Ai Red Teaming Expert. Job in London LilyLifestyle Jobs
Some tips for your application 🫡
Tailor Your CV:Make sure your CV speaks directly to the job description. Highlight your experience with AWS Bedrock and any relevant compliance knowledge. We want to see how your skills align with our needs!
Showcase Your Projects:Include specific examples of projects where you've implemented automated red teaming or worked on AI/ML systems. This helps us understand your hands-on experience and technical expertise.
Be Clear and Concise:When writing your application, keep it straightforward. Use bullet points for key achievements and avoid jargon unless it's necessary. We appreciate clarity as much as complexity!
Apply Through Our Website:Don’t forget to submit your application through our website! It’s the best way for us to track your application and ensure it gets the attention it deserves.
How to prepare for a job interview at United Cerebral Palsy of Georgia
✨Know Your Stuff
Make sure you brush up on your knowledge of AWS Bedrock and the specific tools mentioned in the job description, like Garak and Pyrit. Being able to discuss your hands-on experience with these technologies will show that you're not just familiar with them, but that you can actually implement them effectively.
✨Understand Compliance Inside Out
Familiarise yourself with FCA Operational Resilience, DORA, and the EU AI Act, especially Article 15. Be prepared to discuss how you've navigated regulatory requirements in past roles and how you would ensure compliance in this position.
✨Showcase Your Problem-Solving Skills
Prepare examples of how you've tackled challenges related to automated adversarial testing and evaluation. Think about specific situations where you built measurement frameworks or addressed security threats, and be ready to share those stories during the interview.
✨Ask Insightful Questions
Come prepared with questions that demonstrate your interest in the role and the company. Ask about their current projects related to AI supply chain integrity or how they measure success rates across their systems. This shows that you're engaged and thinking critically about the role.
