At a Glance
- Tasks: Evaluate AI responses and provide feedback to enhance model performance.
- Company: Join a leading AI research company backed by top investors.
- Benefits: $100/hour, fully remote work, and flexible hours.
- Other info: Ideal for detail-oriented individuals seeking independent work.
- Why this job: Make a real impact on AI development while working from anywhere.
- Qualifications: Bachelor's degree preferred, strong analytical and writing skills required.
The predicted salary is between 72000 - 72000 € per year.
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Generalist Expert
Type: Contract
Compensation: $100/hour
Location: Remote
Role Responsibilities:
- Evaluate AI-generated responses to enhance reasoning and rigor in model outputs.
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
- Collaborate with AI research teams to ensure consistency and coverage across datasets.
- Work independently and asynchronously to meet deadlines while improving AI model performance.
Qualifications:
Must-Have:
- Bachelor's degree from a top-100 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Ability to write clear, precise, and well-evidenced written rationales.
- Consistent and honest judgment, including the ability to give critical assessments.
- Strict attention to detail and accurate application of structured evaluation guidelines.
- Ability to work entirely without AI writing tools.
- Native English fluency required.
Preferred:
- Candidates based in the United States, United Kingdom, Canada, Australia, or New Zealand.
Critical Reviewer - Fully Remote in London employer: Mercor
Mercor is an exceptional employer that fosters a dynamic and innovative work culture, connecting top-tier talent with leading AI research labs. As a fully remote company, we offer flexible working arrangements that empower our employees to thrive independently while contributing to groundbreaking advancements in AI. With competitive compensation and opportunities for professional growth, Mercor is dedicated to enhancing the skills and expertise of its team members in a supportive environment.
StudySmarter Expert Advice🤫
We think this is how you could land Critical Reviewer - Fully Remote in London
✨Tip Number 1
Network like a pro! Reach out to people in the AI and tech space, especially those who work at companies you're interested in. A friendly chat can open doors that a CV just can't.
✨Tip Number 2
Show off your skills! Create a portfolio or a blog where you can showcase your critical reviewing abilities. This is a great way to demonstrate your analytical skills and writing prowess beyond what’s on paper.
✨Tip Number 3
Prepare for interviews by practising common questions related to AI and critical analysis. We recommend doing mock interviews with friends or using online platforms to get comfortable with articulating your thoughts.
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our team.
We think you need these skills to ace Critical Reviewer - Fully Remote in London
Some tips for your application 🫡
Show Off Your Skills:Make sure to highlight your analytical and written communication skills in your application. We want to see how you can evaluate AI-generated responses and provide structured feedback, so don’t hold back!
Be Precise and Clear:When writing your application, clarity is key. We’re looking for well-evidenced rationales, so ensure your writing is precise and free of fluff. This will show us you can communicate effectively, just like the role requires.
Follow the Guidelines:Pay close attention to any guidelines provided in the application process. We appreciate candidates who can follow detailed task instructions, as this reflects your ability to work independently and meet deadlines.
Apply Through Our Website:We encourage you to apply through our website for a smoother process. It’s the best way for us to receive your application and ensures you don’t miss out on any important details!
How to prepare for a job interview at Mercor
✨Know Your Stuff
Before the interview, make sure you thoroughly understand AI concepts and the role of a Critical Reviewer. Brush up on your analytical skills and be ready to discuss how you can enhance AI-generated responses with structured feedback.
✨Showcase Your Writing Skills
Since strong written communication is key for this role, prepare examples of your writing that demonstrate clarity and precision. You might even want to bring a sample of your work that showcases your ability to provide well-evidenced rationales.
✨Prepare for Critical Thinking Questions
Expect questions that assess your critical reading skills and your ability to identify nuances in reasoning. Practice articulating your thought process when evaluating AI outputs, as this will show your depth of understanding.
✨Demonstrate Independence
This role requires working independently, so be ready to discuss how you manage your time and meet deadlines without supervision. Share examples from your past experiences where you successfully worked autonomously to achieve results.
