Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Join the Rubric Academy to learn how to evaluate AI and create expert standards.
- Company: Mercor, a leader in AI training and evaluation.
- Benefits: Earn $50 to $150 while learning valuable skills in a self-paced course.
- Why this job: Get paid to upskill and set the standard for AI performance.
- Qualifications: Deep expertise in your field and analytical skills required.
- Other info: Successful graduates can access high-paying expert projects.
The predicted salary is between 40 - 60 £ per hour.
Join to apply for the Rubric Academy Fellowship role at Mercor. Mercor is launching the Rubric Academy, a specialized course designed to teach subject-matter experts how to rigorously evaluate Artificial Intelligence. To build models that can act as true professionals, we need humans who can not only ask the right questions but also define exactly what a perfect answer looks like.
We are looking for professionals with unique domain knowledge to participate in a paid, 3–5 hour instructional course. You will be paid to learn the methodology of "Prompt-Rubric Pairing"—the gold standard for training and benchmarking advanced AI models. Upon successful completion, you will become eligible for our high-paying expert projects.
What You Will Learn
- The Art of the Prompt: Learn to write inputs that set clear context, clarity, and constraints to elicit specific expert behaviours from an AI.
- The "Golden Response": Learn how to define the ideal output. You will move beyond simple fact-checking to articulate the nuance, tone, and logic required for a top-tier professional response.
- Rubric Architecture: Learn to build objective grading systems. You will master writing "Criterion Descriptions," assigning weights, and citing sources to create a mathematical framework for judging AI performance.
Who We Are Looking For
- Deep Expertise: You possess unique knowledge that is difficult to find on the open web. You can cite specific sources (PDFs, data sets) that support your professional judgments.
- Analytical Rigor: You are detail-oriented. You can break down a complex professional task into specific, measurable steps (criteria) that an AI must follow.
- Integrity: You are committed to original work. You understand that using AI to grade AI defeats the purpose, and you rely on your own knowledge and external verification.
Project Details & Compensation
- Stipend: Flat $50 to $150 payment upon successful completion of the Academy lessons and the Practice Task.
- Time Commitment: Approximately 3–5 hours (self-paced).
- Future Opportunities: Successful Graduates will be prioritized for our ongoing Expert Contributor roles (long-term projects creating training data for frontier models).
Requirements: No paid subscriptions are required. You must be able to upload valid sources (PDF/CSV) to support your work.
Why Apply?
- Get Paid to Upskill: Learn a highly technical skill set (Rubric Design and RLHF methodologies) that is essential for the next phase of AI development.
- Set the Standard: Your rubrics will serve as the "ground truth" for AI models, teaching them the difference between a mediocre answer and an expert one.
- Unlock High-Value Work: This Academy is the required entry point for Mercor’s specialized, high-hourly-rate expert projects.
Apply today to join the Rubric Academy and teach AI how to meet your professional standards.
Rubric Academy Fellowship employer: Mercor
Contact Detail:
Mercor Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Rubric Academy Fellowship
✨Tip Number 1
Network like a pro! Reach out to folks in your field, especially those who've been through similar programmes. They can give you insider tips and might even refer you to opportunities that aren't advertised.
✨Tip Number 2
Prepare for interviews by practising common questions related to AI evaluation and rubric design. We recommend doing mock interviews with friends or using online platforms to get comfortable with articulating your expertise.
✨Tip Number 3
Showcase your unique knowledge! Create a portfolio or a blog where you discuss your insights on AI and rubric architecture. This not only demonstrates your expertise but also makes you memorable to recruiters.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Rubric Academy Fellowship
Some tips for your application 🫡
Show Off Your Expertise: Make sure to highlight your unique domain knowledge in your application. We want to see what makes you stand out, so don’t hold back on sharing specific examples and sources that showcase your skills!
Be Clear and Concise: When writing your application, keep it straightforward and to the point. We appreciate clarity, so make sure your responses are easy to read and understand. Avoid jargon unless it’s necessary to demonstrate your expertise.
Tailor Your Application: Take a moment to align your application with the Rubric Academy's goals. Show us how your skills and experiences relate to the course content and the role. This will help us see why you’re a perfect fit for the fellowship!
Apply Through Our Website: Don’t forget to submit your application through our website! It’s the easiest way for us to receive your details and ensures you’re considered for this exciting opportunity. We can’t wait to hear from you!
How to prepare for a job interview at Mercor
✨Know Your Stuff
Before the interview, brush up on your unique domain knowledge. Be ready to discuss specific sources and examples that showcase your expertise. This will not only demonstrate your analytical rigor but also show that you can back up your claims with solid evidence.
✨Master the Art of Prompting
Familiarise yourself with the concept of 'Prompt-Rubric Pairing'. Think about how you would write prompts that elicit the best responses from AI. Being able to articulate this during the interview will highlight your understanding of the role and its requirements.
✨Showcase Your Integrity
Be prepared to discuss your commitment to original work. Share examples of how you've relied on your own knowledge and external verification in past projects. This will resonate well with the values of Mercor and their focus on integrity.
✨Ask Insightful Questions
Interviews are a two-way street! Prepare thoughtful questions about the Rubric Academy and the types of expert projects available. This shows your genuine interest in the role and helps you assess if it's the right fit for you.