At a Glance
- Tasks: Join our AGI safety team to transform AI control research into practical tools.
- Company: Innovative AI research company focused on safety and control.
- Benefits: Competitive salary, unlimited vacation, flexible hours, and professional development budget.
- Other info: Dynamic team environment with opportunities for rapid responsibility and growth.
- Why this job: Make a real impact on AI safety while working with cutting-edge technology.
- Qualifications: 2+ years in empirical research with AI systems and strong Python skills.
The predicted salary is between 72000 - 88000 £ per year.
Join our new AGI safety product team and help transform AI control research into practical tools that directly reduce risks from AI. As a Research Scientist (Control), you’ll work closely with other control researchers and product engineers. We are currently building Watcher, a monitoring tool for coding agents. Our monitoring research agenda attempts to translate compute into safety at scale. You will join a small team and will have significant ability to shape the team & tech, and have the ability to earn responsibility quickly.
You will like this opportunity if you’re passionate about using empirical research to make AI systems safer in practice. You enjoy the challenge of translating theoretical AI risks into concrete detection mechanisms. You thrive on rapid iteration and learning from data. You want your research to directly impact real-world AI safety.
KEY RESPONSIBILITIES
- Design and conduct experiments to test monitor effectiveness across different failure modes and agent behaviors.
- Build and maintain evaluation frameworks to measure progress on monitoring capabilities.
- Build and maintain high-quality datasets to train and test monitors on.
- Iterate on monitoring approaches based on empirical results, balancing detection accuracy with computational efficiency.
- Contribute newly discovered coding agent failure modes to Apollo's shared failure mode library as they surface during monitor design, evaluation, and iteration.
- Stay current with research on AI safety, agent failures, and detection methodologies.
- Stay current with research into coding security and safety vulnerabilities.
Fine-tuning & Monitor Development
- Fine-tune open-source models to create efficient monitors for high-volume production environments.
- Design and build agentic monitoring systems that autonomously investigate logs to identify both known and novel failure modes.
- Incorporate adversarial findings from red‑teaming campaigns into monitor design and evaluation, closing the loop between attack and defense.
JOB REQUIREMENTS
Must-haves
- 2+ years of experience conducting empirical research with large language models or AI systems.
- Strong experience with AI coding agents.
- Experience with LLM-as-a-judge setups or AI monitoring more broadly.
- Experience designing and running experiments, analyzing results, and iterating based on empirical findings.
- Strong Python programming skills.
- Demonstrated ability to work independently on open-ended research problems.
Good-to-haves
- Familiarity with AI safety concepts, particularly agent-related risks.
- Familiarity with computer security, e.g. security testing and secure system design.
- Experience fine-tuning language models or working with smaller open-source models.
- Previous work building developer tools or monitoring systems.
- Publications or contributions to AI safety or ML research.
- Experience with production log systems or production log analysis.
We want to emphasize that people who feel they don’t fulfill all of these characteristics but think they would be a good fit for the position nonetheless are strongly encouraged to apply. We believe that excellent candidates can come from a variety of backgrounds and are excited to give you opportunities to shine.
REPRESENTATIVE PROJECTS
- Hierarchical monitoring for coding agent security: Design a multi-layer monitoring system for detecting security vulnerabilities introduced by coding agents.
- Design a backtesting strategy for Watcher: Validate the system on synthetic test cases and real agent outputs.
- Fine-tune an open-source model to be a great monitor: Take an open-source model and fine-tune it on our large dataset of coding agent failures.
BENEFITS
- This role offers market competitive salary, equity, and competitive benefits.
- Flexible work hours and schedule.
- Unlimited vacation.
- Unlimited sick leave.
- Up to 6 months of paid parental leave.
- Comprehensive health, dental and vision insurance.
- Retirement savings with competitive employer matching.
- Lunch, dinner, and snacks are provided for all employees on workdays.
- Paid work trips, including staff retreats, business trips, and relevant conferences.
- A yearly $1,000 (USD) professional development budget.
- Relocation support and visa fees (if applicable).
LOGISTICS
- Time Allocation: Full-time.
- Location: This is an in‑person role working out of our London or San Francisco office.
- Visa sponsorship: We sponsor visas in both the UK and US.
ABOUT THE TEAM
The product team consists of research scientists and product engineers. Marius Hobbhahn (CEO) advises the team. Furthermore, you will interact with our other SWEs and researchers, since we intend to be "our own customer" by using our products internally for our research work.
ABOUT APOLLO RESEARCH
The rapid rise in AI capabilities offers tremendous opportunities, but also presents significant risks. At Apollo Research, we’re primarily concerned with risks from Loss of Control. We work on the science of scheming, detection of scheming, and scheming mitigations. We also work on control and monitoring research.
Apollo Research is an Equal Opportunity Employer. We value diversity and are committed to providing equal opportunities to all.
Research Scientist (Control) in London employer: COL Limited
Join a pioneering AI research organisation in London, where innovation meets impact. As a Backend Engineer, you'll thrive in a collaborative work culture that values creativity and strong software design practices, while enjoying comprehensive benefits and opportunities for professional growth. This is not just a job; it's a chance to contribute to groundbreaking AGI safety research and make a meaningful difference in the field.
StudySmarter Expert Advice🤫
We think this is how you could land Research Scientist (Control) in London
✨Join Local Tech Meetups
Get out there and mingle with fellow developers by joining local tech meetups. It’s a fantastic way to meet people who might be working at COL Limited or know someone who does. Plus, you can pick up some trendy tech skills and trends while you're at it!
✨Contribute to Open Source Projects
Show off your coding chops by jumping into open-source projects. Not only does this give you practical experience, but it also gets you noticed in the dev community. You'll create a killer portfolio that speaks volumes about your skills to COL Limited.
✨Tap into Online Developer Communities
Don’t underestimate the power of online developer communities like GitHub, Stack Overflow, and even Reddit. Participate in discussions, share your projects, and build your visibility. We can often find opportunities through these channels that can lead to a full-time gig at companies like COL Limited.
✨Explore Job Boards Specifically for Tech Roles
Keep your eyes peeled on job boards that focus on tech roles. Sites like TechCareers or Stack Overflow Jobs can often have listings for companies like COL Limited that might not show up on broader job sites. Make it a habit to check these regularly, and don’t hesitate to apply directly through our website!
We think you need these skills to ace Research Scientist (Control) in London
Some tips for your application 🫡
Show off your coding skills:When applying for a software engineering role, it's super important to showcase your coding skills. Make sure your CV includes your tech stack, any relevant programming languages you’re comfortable with, and examples of projects you've worked on. If you have a GitHub profile, link it up! We love to see code in action.
Tailor your portfolio:For a full-time role, we’d expect to see some solid examples of your work in your portfolio. Make sure to include at least two or three projects that highlight your problem-solving skills and your ability to work with different technologies. Focus on the projects that are most relevant to the position at COL Limited.
Craft a killer cover letter:Your cover letter is your chance to stand out—make it personal! Explain why you want to work at COL Limited and how your skills align with the role. Show us your passion for software development. We dig enthusiastic candidates who understand the value of collaboration and continuous learning!
Be clear and concise:When it comes to writing your CV and cover letter, clarity is key. Avoid jargon that could confuse us and stick to simple, direct language. Highlight your achievements with quantifiable results where possible, and keep everything easy to read. A well-organised application goes a long way!
How to prepare for a job interview at COL Limited
✨Brush Up on Your Coding Skills
For a full-time software engineering role, it's crucial that we stay sharp with our coding abilities. Expect technical questions that might involve solving problems on the spot or discussing algorithms. Practise on platforms like LeetCode or HackerRank to get comfortable with the types of questions that often come up.
✨Know Your Tools and Frameworks
Make sure we’re well-acquainted with the tools and technologies listed in the job description. Familiarise ourselves with any specific frameworks or programming languages mentioned. If COL Limited uses React or Node.js, for instance, be ready to discuss how we’ve used them in previous projects or coursework.
✨Showcase Your Projects
Bring along a portfolio that highlights our best work. This could be code samples, GitHub repositories, or any side projects we’ve built. Make sure we can talk through our thought process for each project, especially the challenges we faced and how we solved them—this shows our problem-solving skills in action.
✨Prepare for Behavioural Questions
While technical skills are key, full-time positions also require cultural fit. Be ready to discuss our previous experiences and how we handle teamwork, conflict, and deadlines. Brush up on the STAR method—Situation, Task, Action, Result—to clearly articulate our past experiences when discussing how we've contributed to a team.