At a Glance
- Tasks: Evaluate AI-generated outputs and provide evidence-based feedback on realistic business tasks.
- Company: Mercor, a forward-thinking company exploring AI in professional work.
- Benefits: Flexible hours, competitive pay for a one-time study, and the chance to influence AI development.
- Other info: Short commitment of 8-12 hours with potential for impactful insights.
- Why this job: Be part of an innovative pilot that shapes the future of AI in business.
- Qualifications: 5+ years in HR or Accounting, with strong judgment and writing skills.
The predicted salary is between 99 - 121 £ per hour.
Mercor is running a short, structured evaluation pilot to measure how frontier AI models perform on realistic professional work — and how experienced practitioners judge that work. We are hiring 50 experts across two business domains. Each expert completes one task, then evaluates five model attempts at that same task. This is a one-time study, not ongoing production work.
What You’ll Do
- Sign an NDA before receiving any materials.
- Solve one realistic, domain-specific task using the source files provided.
- Review five model-generated outputs for that task.
- Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales that cite specific parts of the output.
- Provide structured feedback on the task itself and on the study design.
Time Commitment
Estimated 8-12 hours.
Study Conditions
No rubric and no golden answer are provided. Your professional judgment is the measurement. Use of LLMs or other AI assistants is prohibited at every stage — solving, ranking, scoring, and writing rationales.
Domains we are focused on
- Human Resources
- Accounting
Who We're Looking For
- 5+ years of hands‑on professional experience in one of the two domains above.
- Currently or recently practicing, so you can judge the work the way a working professional would.
- Able to write a clear, specific, evidence‑grounded rationale for a judgment.
- Reliable within a short turnaround window.
Eligibility Restriction
You are not eligible for this pilot if you have worked on Project Alchemy in any capacity — task author, reviewer, world expert, or anyone who has had access to its source world data. Prior exposure to that material would invalidate the study.
Business Operations Expert - Evaluator in London employer: Mercor
Mercor is an exceptional employer that champions innovation and creativity in the AI sector, offering a fully remote work environment that promotes flexibility and independence. With a strong focus on employee growth, team members are encouraged to take ownership of their projects while benefiting from a supportive culture that values collaboration and continuous learning. Joining Mercor means being part of a forward-thinking company backed by industry leaders, where your contributions directly impact cutting-edge search technologies.
StudySmarter Expert Advice🤫
We think this is how you could land Business Operations Expert - Evaluator in London
✨Join Business Intelligence Meetups
We can’t stress enough how beneficial it is to attend local Business Intelligence meetups and events. These gatherings often bring together industry professionals and can lead to short-term, temporary roles—perfect if you’re looking to land something quickly. Plus, you’ll get to learn some insider tips and tricks from those already in the game!
✨Leverage Online Freelancing Platforms
Since you’re searching for a temporary gig, check out freelancing platforms like Upwork or Freelancer where businesses often post short-term BI projects. This can be a great way to build your portfolio and gain experience while also showcasing your skills to potential future employers.
✨Show Off Your BI Projects
Whether you’re working on a personal project or a past endeavour, put your work out there! Create a public portfolio that highlights your best Business Intelligence analyses or visualisations. It’ll give you a leg up when you’re approaching companies like Mercor, showing exactly what you can bring to the table.
✨Tap Into University or College Networks
If you're currently studying or recently graduated, make sure to use your university's career services. Many educational institutions have partnerships with companies looking for temporary talent in Business Intelligence, so keep an eye out for exclusive job postings or internship fairs that could lead to a quick placement.
We think you need these skills to ace Business Operations Expert - Evaluator in London
Some tips for your application 🫡
Show Off Your Data Skills:In business intelligence, it's crucial to highlight your analytical skills and experience with data tools. Make sure your CV showcases any relevant software you’ve used, like SQL, Tableau, or Power BI. Add specific examples of how you've used data to drive insights or improvements in previous roles, even if they were in academic projects or internships.
Keep it Concise and Impactful:For a temporary role like this, hiring managers often have limited time to sift through applications. Get straight to the point in your CV and cover letter. Use bullet points for your achievements, showcasing the impact you've made, like percentage increases in efficiency or specific results from your analyses.
Flexibility is Key:Since this is a temporary position, make sure to emphasise your adaptability. Mention your quick learning abilities and experiences where you adapted to new tools or processes rapidly. This will show that you can jump in and start contributing effectively from day one at Mercor.
Craft a Tailored Motivation Statement:In your cover letter, focus on why you’re excited about this temporary role at Mercor. Talk about your interest in business intelligence and how this position aligns with your career goals. Remember, it’s not just about what you can offer, but why you’re passionate about becoming part of their team, even for a short time!
How to prepare for a job interview at Mercor
✨Brush Up on Your Data Skills
For a business intelligence role, you'll want to showcase your analytical skills and familiarity with data visualisation tools like Tableau or Power BI. Be ready to tackle technical questions or case studies demonstrating your ability to interpret data and make insightful recommendations.
✨Plan Your Portfolio of Projects
Since this is a temporary position, we should highlight any past projects you've worked on in business intelligence. Prepare a portfolio that includes a couple of key pieces where you've effectively utilised data to drive decisions—this will show that you're not just a quick fix but someone who can deliver immediate value.
✨Demonstrate Your Adaptability
Temporary roles often require us to hit the ground running, so be ready to discuss how you quickly adapt to new tools, teams, and environments. Share specific examples from previous experiences where you thrived under pressure or had to learn a new system or process in a short time frame.
✨Have Your Metrics Ready
In business intelligence, quantifying your impact is key. Come prepared to share metrics from your past work: think percentages, growth figures, or efficiency improvements. This will really help us paint a picture of how your contributions directly benefited those previous roles.
