Anthropic AI Safety Fellow, US

Note: this is our US job posting. You can find our UK and Canada job postings on our careers page.

Please apply by August 17!

Responsibilities:

The Anthropic Fellows Program is an external collaboration program focused on accelerating progress in AI safety research by providing promising talent with an opportunity to gain research experience. The program will run for about 2 months, with the possibility of extension for another 4 months, based on how well the collaboration is going. Our goal is to bridge the gap between industry engineering expertise and the research skills needed for impactful work in AI safety.

• Fellows will use external infrastructure (e.g. open-source models, public APIs) to work on an empirical project aligned with our research priorities, with the goal of producing a public output (e.g. a paper submission). Fellows will receive substantial support – including mentorship from Anthropic researchers, funding, compute resources, and access to a shared workspace – enabling them to develop the skills to contribute meaningfully to critical AI safety research.
• We aim to onboard our next cohort of Fellows in October 2025, with later start dates being possible as well.

What To Expect

• Direct mentorship from Anthropic researchers
• Connection to the broader AI safety research community
• Weekly stipend of $2,100 USD & access to benefits (including access to medical, dental, and vision insurance, a Health Savings Account, an Employee Assistance Program, and a 401(k) retirement plan)
• Funding for compute and other research expenses
• Shared workspaces in Berkeley, California and London, UK
• This role will be employed by our third-party talent partner, and may be eligible for benefits through the employer of record.

Mentors & Research Areas

Fellows will undergo a project selection & mentor matching process. Potential mentors include

Ethan Perez
Jan Leike
• Emmanuel Ameisen
Jascha Sohl-Dickstein
Sara Price
Samuel Marks
Joe Benton
Akbir Khan
Fabien Roger
Alex Tamkin
Nina Panickssery
Collin Burns
• Jack Lindsey
• Trenton Bricken
Evan Hubinger

Our mentors will lead projects in select AI safety research areas, such as:

• Scalable Oversight: Developing techniques to keep highly capable models helpful and honest, even as they surpass human-level intelligence in various domains.
• Adversarial Robustness and AI Control: Creating methods to ensure advanced AI systems remain safe and harmless in unfamiliar or adversarial scenarios.
• Model Organisms: Creating model organisms of misalignment to improve our empirical understanding of how alignment failures might arise.
• Model Internals / Mechanistic Interpretability: Advancing our understanding of the internal workings of large language models to enable more targeted interventions and safety measures.
• AI Welfare: Improving our understanding of potential AI welfare and developing related evaluations and mitigations.

For a full list of representative projects for each area, please see these blog posts: Introducing the Anthropic Fellows Program for AI Safety Research, Recommendations for Technical AI Safety Research Directions.

You may be a good fit if you:

• Are motivated by reducing catastrophic risks from advanced AI systems
• Are excited to transition into full-time empirical AI safety research and would be interested in a full-time role at Anthropic
  • Please note: We do not guarantee that we will make any full-time offers to Fellows. However, strong performance during the program may indicate that a Fellow would be a good fit here at Anthropic, and external collaborations have historically provided our teams with substantial evidence that someone might be a good hire.
• Have a strong technical background in computer science, mathematics, physics, or related fields
• Have strong programming skills, particularly in Python and machine learning frameworks
• Can work full-time on the fellowship for at least 2 months, and ideally 6 months
• Have or can obtain US, UK, or Canadian work authorisation, and are able to work full-time out of Berkeley or London (or remotely if in Canada).
  • While we are not able to sponsor visas, we are able to support Fellows on F-1 visas who are eligible for full-time OPT/CPT.
• Are comfortable programming in Python
• Thrive in fast-paced, collaborative environments
• Can execute projects independently while incorporating feedback on research direction

We’re open to all experience levels and backgrounds that meet the above criteria – you do not, for example, need prior experience with AI safety or ML. We particularly encourage applications from underrepresented groups in tech.

Strong candidates may also have:

• Experience with empirical ML research projects
• Experience working with Large Language Models
• Experience in one of the research areas (e.g. Interpretability)
• Experience with deep learning frameworks and experiment management
• Track record of open-source contributions

Candidates need not have:

• 100% of the skills needed to perform the job
• Formal certifications or education credentials

Interview process:

We aim to onboard our next cohort of Fellows in October 2025, with the possibility of later start dates for some fellows. Please note that if you are accepted into the October cohort, we expect that you will be available for several hours of mentor matching in October, although you may start the full-time program later.

To ensure we can start onboarding Fellows in October 2025, we will complete interviews on a rolling basis until August 17, after which we will conduct interviews at specific timeslots on pre-specified days. We will also set hard cut-off dates for each stage– if you are not able to make that stage’s deadline, we unfortunately will not be able to proceed with your candidacy.

We\’ve outlined the interviewing process below, but this may be subject to change.

1. Initial Application and References
   • Submit your application below by August 17!
   • In the application, we’ll also ask you to provide references who can speak to what it’s like to work with you.
2. Technical Assessment
   • You will complete a 90-minute coding screen in Python
     • As a quick note – we know most auto-screens are pretty bad. We think this one is unusually good and for some teams, give as much signal as an interview. It’s a bunch of reasonably straightforward coding that involves refactoring and adapting to new requirements, without any highly artificial scenarios or cliched algorithms you’d gain an advantage by having memorized.
   • We\’ll simultaneously collect written feedback from your references during this stage.
3. Technical Interview
   • You\’ll schedule time to do a coding-based technical interview that does not involve any machine learning (55 minutes)
4. Final interviews
   • The final interviews consist of two interviews:
     • Research Discussion (15 minutes) – Brainstorming session with an Alignment Science team lead to explore research ideas and approaches
     • Take-Home Project (5 hours work period + 30 minute review) – Research-focused project that demonstrates your technical and analytical abilities
   • In parallel, we will conduct reference calls.
5. Offer decisions
   • We aim to extend all offers by early October, and finalize our cohort shortly after.
   • We will extend offers on a rolling basis and set an offer deadline of 1 week. However, if you need more time for the offer decision, please feel free to ask for it!
   • After we select our initial cohort, we will kick off mentor matching and project selection in mid/late-October (the first week of the program). This will involve several project discussion sessions and follow-up discussions.
   • We\’ll extend decisions about extensions in mid-December. Extended fellowships will end in mid/late-April.

At each stage, you\’ll receive more detailed instructions via email. While we have hard deadlines for each stage, we will be assessing candidates and making offer decisions on a rolling basis, so we encourage you to complete each stage as soon as possible.

Compensation (USD):

• This role is not a full-time role with Anthropic, and will be hired via our third-party talent partner.
• The expected base pay for this role is $2,100/week, with an expectation of 40 hours per week.

Role-Specific Location Policy:

• While we currently expect all staff to be in one of our offices at least 25% of the time, this role is exempt from that policy and can be done remotely from anywhere in the US.
• However, we strongly prefer candidates who can be based in the Bay Area and make use of the shared workspace we\’ve secured for our Fellows.

Please note: The logistics below this section does not apply to this job posting (for example, we are not able to sponsor visas for Fellows).

#J-18808-Ljbffr