At a Glance
- Tasks: Evaluate AI-generated content and assign preference rankings to improve model performance.
- Company: Join a leading AI talent connector backed by top investors.
- Benefits: Earn $25–$35/hour, work remotely, and enjoy flexible hours.
- Why this job: Make an impact on AI technology while working independently and flexibly.
- Qualifications: Experience in data labeling or content moderation with strong critical thinking skills.
- Other info: Opportunity for part-time work with weekly payments and career growth.
The predicted salary is between 20 - 28 £ per hour.
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Preference Ranking Model Evaluator
Type: Freelance
Compensation: $25–$35/hour
Location: Remote
Commitment: 10–20 hours/week
Role Responsibilities
- Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness.
- Assign preference rankings to pairs or sets of model outputs.
- Follow detailed labeling guidelines and adjust based on evolving criteria.
- Provide brief written explanations for ranking decisions when required.
- Flag edge cases or inconsistencies in task design or model output.
- Work independently and asynchronously to meet deadlines while improving AI model performance.
Qualifications
- Prior experience in data labeling, content moderation, or preference ranking tasks.
- Excellent critical thinking and reading comprehension skills.
- Comfort working with evolving guidelines and ambiguity.
- Strong attention to detail and consistency across repetitive tasks.
- Availability for regular part-time work on a weekly basis.
Compensation & Legal
Payments issued weekly via Stripe Connect. Classified as an independent contractor.
Application Process (Takes 20–30 mins to complete)
- Submit your resume.
- Complete a short form to highlight your relevant experience.
- You may be asked to complete a brief assessment to evaluate task fit.
Resources & Support
For details about the interview process and platform information, please check: Interview Process
For any help or support, reach out to: support@mercor.com
Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Remote Content Quality Analyst in Newcastle upon Tyne employer: Mercor
Contact Detail:
Mercor Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Remote Content Quality Analyst in Newcastle upon Tyne
✨Tip Number 1
Get familiar with the role! Dive into the job description and understand what they’re looking for. This way, you can tailor your approach and show them you’re the perfect fit.
✨Tip Number 2
Don’t just submit your resume and wait! Follow up with a friendly email to express your enthusiasm. A little nudge can go a long way in showing you’re genuinely interested.
✨Tip Number 3
Prepare for potential assessments! Brush up on your critical thinking and reading comprehension skills, as these will be key in evaluating AI-generated responses.
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it’s super easy and quick to do!
We think you need these skills to ace Remote Content Quality Analyst in Newcastle upon Tyne
Some tips for your application 🫡
Craft a Tailored Resume: Make sure your resume highlights your relevant experience in data labeling or content moderation. We want to see how your skills align with the role, so don’t be shy about showcasing your critical thinking and attention to detail!
Complete the Short Form Thoughtfully: When filling out the short form, take your time to provide clear and concise examples of your past work. This is your chance to shine, so let us know how you've tackled similar tasks before!
Be Ready for the Assessment: If we ask you to complete a brief assessment, treat it like a mini-interview. Show us your thought process and how you approach ranking tasks. It’s all about demonstrating your fit for the role!
Apply Through Our Website: We encourage you to apply directly through our website. It streamlines the process for us and ensures your application gets the attention it deserves. Plus, it’s super easy!
How to prepare for a job interview at Mercor
✨Know Your Stuff
Before the interview, make sure you brush up on your experience with data labeling and content moderation. Be ready to discuss specific examples where you've evaluated quality and coherence in outputs, as this will show your understanding of the role.
✨Familiarise Yourself with Guidelines
Since the job involves following detailed labeling guidelines, take some time to review any relevant materials or similar guidelines. This will help you demonstrate your ability to adapt to evolving criteria during the interview.
✨Showcase Your Critical Thinking
Prepare to discuss how you approach critical thinking and problem-solving. Think of scenarios where you had to make tough decisions based on ambiguous information, as this will highlight your ability to work independently and handle edge cases.
✨Ask Insightful Questions
At the end of the interview, don’t hesitate to ask questions about the team dynamics or the tools they use for evaluating AI responses. This shows your genuine interest in the role and helps you gauge if it’s the right fit for you.