AI Evaluation Engineer (Remote) (Southampton)

AI Evaluation Engineer (Remote) (Southampton)

Part-Time 50000 - 70000 € / year (est.) No home office possible
Outlier AI

At a Glance

  • Tasks: Help improve AI agents by providing human feedback and training advanced generative systems.
  • Company: Outlier, a leader in AI collaboration with innovative companies.
  • Benefits: Remote work options, competitive salary, and opportunities for professional growth.
  • Other info: Dynamic remote environment with a focus on real-world applications.
  • Why this job: Join a cutting-edge project that shapes the future of AI technology.
  • Qualifications: 2+ years in backend engineering or AI automation; strong coding skills required.

The predicted salary is between 50000 - 70000 € per year.

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. We collaborate with leading AI organizations to train Large Language Models (LLMs) to function as proactive, multi-step agents. Our projects focus on teaching these systems how to design, coordinate, and optimize complex, real-world architectural workflows.

Whether you are a passionate orchestration guru or experienced software developer, we want you to help us train the world's most advanced generative systems.

  • 2+ years of experience in backend engineering, AI automation, or complex systems integration.
  • Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for data parsing, logic processing, and reporting).
  • Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java) and experience working with SQL databases.
  • Practical experience building for live, non-mocked environments and handling multi-turn system interactions.
  • Expertise building multi-stage coordination tasks where data acquisition leads to reasoned output.

Remote working/work at home options are available for this role.

AI Evaluation Engineer (Remote) (Southampton) employer: Outlier AI

Outlier is an exceptional employer that champions innovation and collaboration in the AI sector, offering a dynamic remote work environment from Southampton. With a strong focus on employee growth, we provide opportunities for professional development and the chance to work on cutting-edge projects that shape the future of AI technology. Our inclusive work culture fosters creativity and teamwork, making it a rewarding place for passionate individuals to thrive.

Outlier AI

Contact Detail:

Outlier AI Recruiting Team

StudySmarter Expert Advice🤫

We think this is how you could land AI Evaluation Engineer (Remote) (Southampton)

Tip Number 1

Network like a pro! Reach out to folks in the AI and software development communities. Join relevant online forums, attend virtual meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings!

Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those involving AI automation or backend engineering. Highlight your experience with languages like Python or JavaScript, and make sure to include any complex systems you've worked on.

Tip Number 3

Prepare for interviews by brushing up on your technical knowledge. Be ready to discuss your experience with SQL databases and multi-turn system interactions. Practise explaining your thought process when tackling complex architectural workflows.

Tip Number 4

Apply through our website! We love seeing applications directly from candidates who are excited about our projects. Tailor your application to highlight how your skills align with what we’re looking for in an AI Evaluation Engineer.

We think you need these skills to ace AI Evaluation Engineer (Remote) (Southampton)

Backend Engineering
AI Automation
Complex Systems Integration
Production-Grade Software Development
Modular Software Architecture
Python
JavaScript

Some tips for your application 🫡

Show Off Your Skills:Make sure to highlight your experience in backend engineering and AI automation. We want to see how you've built and maintained production-grade software, so don’t hold back on those details!

Be Specific About Your Experience:When you mention your programming languages, be specific about your projects. If you've worked with Python or JavaScript, share examples of how you've used them in real-world scenarios. We love seeing practical applications!

Tailor Your Application:Don’t just send a generic application. Tailor your CV and cover letter to reflect the skills and experiences that align with our job description. Show us why you’re the perfect fit for the AI Evaluation Engineer role!

Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it’s super easy!

How to prepare for a job interview at Outlier AI

Know Your Tech Inside Out

Make sure you brush up on your programming languages, especially Python and JavaScript. Be ready to discuss your experience with SQL databases and how you've built production-grade software in the past. They’ll want to see that you can handle complex systems integration.

Showcase Your Problem-Solving Skills

Prepare examples of how you've tackled multi-stage coordination tasks or complex workflows. Think about specific projects where your input led to significant improvements in AI performance. This will demonstrate your ability to think critically and apply your knowledge practically.

Familiarise Yourself with AI Concepts

Since the role focuses on AI agents and LLMs, it’s crucial to understand the basics of how these systems work. Brush up on recent advancements in AI and be ready to discuss how you can contribute to training these advanced generative systems.

Ask Insightful Questions

Prepare thoughtful questions about the company’s projects and their approach to AI evaluation. This shows your genuine interest in the role and helps you gauge if the company is the right fit for you. Plus, it gives you a chance to engage with the interviewers on a deeper level.