At a Glance
- Tasks: Evaluate AI-generated research plans and provide structured feedback to enhance machine learning models.
- Company: Join Mercor, a global talent marketplace for cutting-edge AI research.
- Benefits: Earn up to $140/hour, work remotely, and enjoy flexible hours.
- Why this job: Contribute to groundbreaking AI projects and shape the future of machine learning.
- Qualifications: 5+ years in applied machine learning or a PhD in related fields required.
- Other info: Independent contractor role with opportunities for meaningful contributions and career growth.
Mercor is partnering with a leading AI research lab on Project Vesuvius, an initiative designed to evaluate and enhance the ability of large language models (LLMs) to generate structured, high-quality research plans for open-ended machine learning problems. We are seeking Machine Learning Researchers and PhDs to serve as annotators who will assess and provide structured feedback on AI-generated research plans. The goal is to improve how LLMs function as brainstorming partners for machine learning research. This is a remote, short-term engagement with flexible hours and opportunities to contribute to frontier AI evaluation and research.
Key Responsibilities
- Evaluate and compare AI-generated research plans for clarity, feasibility, and technical soundness.
- Design and compile ML tasks based on real-world challenges and research competitions.
- Draft detailed, executable natural language plans for machine learning workflows.
- Implement and validate research plans in Python within a Docker environment.
- Assess outputs against structured rubrics, provide usefulness scores, and deliver concise, objective feedback.
Ideal Qualifications
- 5+ years of experience in applied machine learning or a PhD in machine learning or related fields.
- Strong understanding of ML research methodologies, experimental design, and evaluation practices.
- Excellent analytical and technical writing skills.
- Experience with reproducibility or benchmarking in ML research preferred.
- Detail-oriented and able to deliver high-quality, structured feedback independently.
Engagement Details
- Type: Independent contractor
- Mode: Fully remote and asynchronous – work from anywhere, on your own schedule.
- Commitment: Maximum 80 hours per week
- Project Name: Vesuvius
This role is designed for researchers and engineers who value autonomy, precision, and meaningful contribution to frontier AI development.
Compensation
- Hourly Pay Rate: Up to $140/hour
- Payment: Weekly via Stripe Connect
- Contract Type: Independent contractor engagement
- Structure: Remote, milestone-based evaluation with flexible scheduling
Application Process
- Submit your resume or CV highlighting relevant ML research or engineering experience.
- Complete a short AI-based interview and a brief questionnaire about your experience with reproducibility and model benchmarking.
- Selected candidates will receive detailed onboarding materials and access to the project environment.
About Mercor
Mercor is a global talent marketplace connecting exceptional professionals with leading AI labs and research organizations. Our mission is to empower experts to contribute directly to the most influential and technically advanced AI projects worldwide. Mercor is backed by investors including Benchmark, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey. Thousands of professionals across disciplines – from research and engineering to law and design – have joined Mercor to build the next generation of artificial intelligence systems.
Machine Learning Researchers in London employer: Mercor
Contact Detail:
Mercor Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Machine Learning Researchers in London
✨Tip Number 1
Network like a pro! Reach out to fellow researchers and professionals in the AI field. Join online forums, attend webinars, and don’t be shy about sliding into DMs on LinkedIn. You never know who might have the inside scoop on opportunities!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your best work in machine learning. Include projects that highlight your analytical skills and technical writing. This will give potential employers a taste of what you can bring to the table.
✨Tip Number 3
Prepare for interviews by brushing up on common ML concepts and methodologies. Practice articulating your thought process when evaluating AI-generated plans. Remember, they want to see how you think, so don’t hold back!
✨Tip Number 4
Apply through our website! It’s the easiest way to get your application noticed. Plus, we love seeing candidates who take the initiative to engage directly with us. So, don’t hesitate – hit that apply button!
We think you need these skills to ace Machine Learning Researchers in London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your relevant experience in machine learning and research. We want to see how your skills align with the role, so don’t be shy about showcasing your achievements!
Show Off Your Writing Skills: Since this role involves drafting detailed plans, it’s crucial to demonstrate your technical writing prowess. Include examples of your previous work that showcase your ability to communicate complex ideas clearly.
Be Honest in the Questionnaire: When filling out the questionnaire about reproducibility and benchmarking, be genuine about your experiences. We appreciate transparency and want to understand your background better.
Apply Through Our Website: Don’t forget to submit your application through our website! It’s the best way for us to receive your details and get you started on this exciting journey with Project Vesuvius.
How to prepare for a job interview at Mercor
✨Know Your ML Stuff
Make sure you brush up on your machine learning methodologies and experimental design. Be ready to discuss your past experiences in detail, especially any projects where you've evaluated AI outputs or worked with LLMs. This will show that you’re not just familiar with the theory but have practical insights too.
✨Prepare for Technical Questions
Expect some technical questions related to Python, Docker, and ML workflows. Practise explaining your thought process when implementing research plans and how you validate them. Being able to articulate your approach clearly will demonstrate your analytical skills and technical prowess.
✨Showcase Your Feedback Skills
Since the role involves providing structured feedback, think of examples where you’ve assessed research plans or outputs before. Prepare to discuss how you evaluate clarity, feasibility, and technical soundness, and be ready to share your scoring methods or rubrics.
✨Emphasise Your Autonomy
This position values independence, so highlight your ability to work autonomously and manage your time effectively. Share examples of how you’ve successfully completed projects remotely, ensuring you convey your detail-oriented nature and commitment to high-quality work.