At a Glance
- Tasks: Run evaluations on cutting-edge AI systems and analyse fascinating behavioural patterns.
- Company: Join a pioneering research team at Apollo Research, collaborating with top AI labs.
- Benefits: Enjoy competitive salary, unlimited vacation, and a yearly professional development budget.
- Other info: Diverse team environment with opportunities for growth and innovation.
- Why this job: Be among the first to interact with new AI models and shape their deployment.
- Qualifications: Strong Python skills, data analysis experience, and a passion for AI.
The predicted salary is between 72000 - 144000 £ per year.
Application Deadline: We are conducting interviews actively and aim to fill this role as soon as we find someone suitable.
About The Opportunity: We develop and run evaluations that help assess the risks posed by scheming AIs. You will get to work with frontier labs like OpenAI, Anthropic, and Google DeepMind and be amongst the first to interact with new models before anyone else. The ideal candidate loves rigorously testing frontier AI models and enjoys building efficient pipelines and automating them.
Responsibilities:
- Run pre‐deployment evaluation campaigns on the most capable AI systems in the world. We partner with multiple labs, giving you access to a breadth of models that no single AI lab could offer.
- Deep dive into AI cognition. Scan through thousands of model transcripts to surface behavioural patterns that no one has ever observed before.
- Build new evaluations for frontier risks, from designing novel test environments to scaling them across hundreds of distinct scenarios.
- Work directly with frontier AI developers. Share your findings, engage with their feedback, and see your evaluations directly inform deployment decisions for the most capable AI systems in the world.
- Automate and improve the evaluation pipeline.
Key Requirements:
- Software engineering skills: Our entire stack uses Python. We’re looking for candidates with strong software engineering experience, ideally with production Python code.
- Process optimisation: You always try to improve workflows.
- Data analysis and pattern recognition: You can extract signal from large, messy datasets and are comfortable with quantitative analysis.
- Writing and communication: You succinctly convey qualitative and quantitative findings to technical and non‐technical audiences.
- AI power‐user: You are curious about the capabilities and propensities of frontier AI models.
- Experience with Inspect: We use Inspect as our primary evals framework.
We want to emphasise that people who feel they don’t fulfil all of these characteristics but think they would be a good fit for the position are strongly encouraged to apply.
Benefits:
- Market‐competitive salary, equity, and competitive benefits.
- Salary: £100k – £200k GBP (~$135k – $270k USD).
- Flexible work hours and schedule.
- Unlimited vacation and sick leave.
- Lunch, dinner, and snacks are provided for all employees on workdays.
- Paid work trips, including staff retreats, business trips, and relevant conferences.
- A yearly $1,000 (USD) professional development budget.
Location: London office shared with the London Initiative for Safe AI (LISA) offices. This is an in‐person role. In rare situations, we may consider partially remote arrangements on a case‐by‐case basis. Work visa sponsorship available for UK visas.
About The Team: The current evals team consists of various members who coordinate the research agenda and lead individual projects.
Equality Statement: Apollo Research is an Equal Opportunity Employer. We value diversity and are committed to providing equal opportunities to all.
How to Apply: Please complete the application form with your CV. The provision of a cover letter is optional.
Interview Process: Our multi‐stage process includes a screening interview, a take‐home test, three technical interviews, and a final interview.
Privacy & Fairness: We are committed to protecting your data and ensuring fairness in our recruitment process.
Research Scientist/Engineer (Evaluations) in London employer: Apollo Research
Apollo Research is an exceptional employer, offering a unique opportunity to shape the communications function of a leading AI safety organisation from the ground up. With a commitment to truth-seeking and a collaborative work culture, employees benefit from flexible hours, unlimited vacation, and a generous professional development budget, all while making a meaningful impact in the field of AI safety. Located in San Francisco, the role provides strategic autonomy and the chance to engage with top-tier US media, ensuring that your expertise reaches vital audiences.
StudySmarter Expert Advice🤫
We think this is how you could land Research Scientist/Engineer (Evaluations) in London
✨Tip Number 1
Get to know the company and its projects inside out. When you walk into that interview, show us you've done your homework on our evaluations and the AI models we work with. It’ll impress us and help you stand out!
✨Tip Number 2
Practice makes perfect! Work on hands-on LLM evals projects to get a feel for what we do. This will not only boost your confidence but also give you real examples to discuss during your interviews.
✨Tip Number 3
Don’t shy away from showcasing your unique skills. Whether it’s your knack for data analysis or your experience with Inspect, let us know how you can bring something special to the team!
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows us you’re genuinely interested in joining our team.
We think you need these skills to ace Research Scientist/Engineer (Evaluations) in London
Some tips for your application 🫡
Show Off Your Skills:Make sure to highlight your software engineering skills, especially in Python. We want to see how you've tackled messy problems and turned them into clean solutions, so don’t hold back on showcasing your best work!
Be Clear and Concise:When you write about your experiences, keep it succinct. We appreciate candidates who can convey complex ideas simply, whether it's for a technical or non-technical audience. Remember, clarity is key!
Tailor Your Application:Take a moment to tailor your CV and any optional cover letter to the role. Mention specific experiences that relate to running evaluations and data analysis. This shows us you’re genuinely interested in the position and understand what we do.
Apply Through Our Website:Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it makes the whole process smoother for everyone involved.
How to prepare for a job interview at Apollo Research
✨Know Your AI Models
Familiarise yourself with the latest AI models and their capabilities. Since you'll be working with cutting-edge technology, being able to discuss specific models and their behaviours will show your genuine interest and expertise in the field.
✨Showcase Your Python Skills
Since the role requires strong software engineering skills in Python, be prepared to discuss your past projects and how you've used Python to solve complex problems. Bring examples of your code or projects that demonstrate your ability to create clean abstractions from messy data.
✨Prepare for Technical Interviews
The technical interviews will focus on tasks relevant to the job, so practice hands-on LLM evals projects. Use the starter guide provided by the company to get a feel for what they expect and to showcase your practical skills during the interview.
✨Communicate Clearly
You'll need to convey your findings to both technical and non-technical audiences. Practice summarising complex ideas succinctly and clearly, as this will be crucial in demonstrating your communication skills during the interview process.
