Safeguards Enforcement Lead (Cyber Harms) in Ashington

Safeguards Enforcement Lead (Cyber Harms) in Ashington

Ashington Full-Time On-site
A
  • As an Enforcement Lead, you will be responsible for managing and executing enforcement actions across our products and services, with a focus on detecting and mitigating attempts to misuse Anthropic's AI systems for malicious cyber operations
  • Your work will center on developing strategic enforcement frameworks for flagged activity related to cyberattacks, malware development, and offensive exploitation
  • Additionally, you will manage a team of Cyber Enforcement Analysts and contractors implementing this enforcement strategy
  • Safety is core to our mission, and you'll help uphold policy enforcement so that our users can safely interact with and build on top of our products in a harmless, helpful, and honest way
  • Important context for this role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a violent, technical, or psychologically disturbing nature
  • This role may require responding to escalations during weekends and holidays
  • Manage a team of Cyber Enforcement Analysts and contractors, overseeing the vision of Cyber Enforcement strategy
  • Create strategies to detect and mitigate potential misuse of AI systems to facilitate cyberattacks, malware creation, exploitation tooling, and related harmful cyber operations
  • Collaborate with stakeholders regarding novel, ambiguous, or high-severity cases
  • Collaborate with the Safeguards Policy Design Team on policy gaps surfaced through real enforcement scenarios
  • Partner with Engineering and Data Science teams to ensure tooling and measurement support enforcement operations
  • Keep up to date with emerging AI policy enforcement best practices, threat actor tactics, and the evolving cyber threat landscape, using these to inform enforcement decisions

Benefits

  • Comprehensive health, dental, and vision insurance for you and your dependents
  • Inclusive fertility benefits via Carrot Fertility
  • 22 weeks of paid parental leave
  • Flexible paid time off and absence policies
  • Mental health support for you and your dependents
  • Competitive salary and equity packages
  • Optional equity donation matching at a 1:1 ratio, up to 25% of your equity grant
  • Retirement plans with competitive matching
  • Life and income protection plans
  • $500/month flexible wellness and time saver stipend
  • Commuter benefits
  • Annual education stipend
  • Home office stipends
  • Relocation support for those moving for Anthropic
  • Daily meals and snacks in the office
  • Proficiency in SQL and/or Python for data analysis and threat detection
  • Experience as a people manager
  • Experience identifying emerging risks and communicating findings to a diverse set of stakeholders, such as Product, Policy, Engineering, and Legal teams
  • Experience performing content review, abuse investigations, or policy enforcement at volume
  • Experience working with generative AI products, including writing effective prompts for content review and enforcement
  • Experience in cybersecurity, including knowledge of offensive techniques, exploit development, malware analysis, or vulnerability research
  • We encourage you to apply even if you do not believe you meet every single qualification
  • Understanding of the challenges involved in implementing product policies at scale, including in the content moderation space
  • Experience working with government agencies, regulated environments, or information sharing communities
  • Experience in trust & safety, abuse investigations, cybersecurity investigations, or threat intelligence in a technology or AI company
  • Experience with large language models and an understanding of how AI technology could be misused for cyber operations
  • Experience operating within abuse monitoring programs or enforcement review systems

#J-18808-Ljbffr

Safeguards Enforcement Lead (Cyber Harms) in Ashington employer: Anthropic

At Anthropic, we pride ourselves on being an exceptional employer that fosters a culture of innovation and collaboration. Our team-oriented environment encourages personal growth and empowers employees to take ownership of their projects, making a meaningful impact in the tech landscape. Located in a vibrant area, we offer competitive benefits and unique opportunities for professional development, ensuring that our engineers thrive both personally and professionally.

A

Contact Details:

Anthropic Recruitment Team