At a Glance
- Tasks: Evaluate AI responses in healthcare, ensuring accuracy and clarity.
- Company: Join a leading AI research lab backed by top investors.
- Benefits: Competitive hourly rate, remote work flexibility, and impactful projects.
- Other info: Quick application process with daily reviews for timely feedback.
- Why this job: Shape the future of healthcare AI while working from anywhere.
- Qualifications: 5+ years in healthcare with an expert degree and LLM experience.
The predicted salary is between 120 - 160 £ per hour.
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Healthcare AI Evaluator
Type: Contract
Compensation: $150–$190/hour
Location: Remote
Role Responsibilities:
- Write and refine prompts to guide model behaviour in healthcare scenarios.
- Evaluate LLM-generated responses to healthcare queries for accuracy, reasoning, clarity, and completeness.
- Conduct fact-checking of medical claims using trusted public sources and authoritative references.
- Annotate model responses by identifying strengths, areas of improvement, and factual inaccuracies.
- Assess tone, completeness, and appropriateness of responses for real-world healthcare use.
- Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.
Qualifications:
Must-Have:
- 5+ years of real-world professional experience in Healthcare, supported by an associated expert degree (e.g., MD, DO, RN, NP, PA, PharmD, MPH, or equivalent).
- Experience in one or more of the following sub-domains: General Clinical Care, Specialty Medicine or Surgery, Diagnostics, Imaging & Laboratory Medicine, Public Health, Healthcare Systems & Administration.
- Significant experience using large language models (LLMs).
- Excellent writing communication skills for complex medical topics.
- Strong attention to detail and comfort in evaluating clinical reasoning and medical explanations.
Preferred:
- Prior experience with RLHF, model evaluation, or data annotation work.
- Experience writing or editing high-quality medical or healthcare-related content.
- Experience in clinical documentation, charting, or patient communication.
- Familiarity with evaluation rubrics, benchmarks, or quality scoring systems.
Application Process: (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support:
For details about the interview process and platform information, please check: Interview Process
For any help or support, reach out to: support@mercor.com
Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Healthcare Services Admin Coordinator in London employer: Mercor
Mercor is an exceptional employer that fosters a dynamic and innovative work culture, connecting top-tier talent with cutting-edge AI research in healthcare. With a focus on employee growth, we offer opportunities to engage in meaningful projects that directly impact the future of healthcare technology, all while enjoying the flexibility of remote work. Our commitment to excellence is matched by our supportive environment, making Mercor a prime choice for professionals seeking to make a difference in the healthcare sector.
StudySmarter Expert Advice🤫
We think this is how you could land Healthcare Services Admin Coordinator in London
✨Tip Number 1
Get your networking game on! Reach out to folks in the healthcare and AI fields. We all know that sometimes it’s not just what you know, but who you know. Attend virtual meetups or webinars to connect with potential employers.
✨Tip Number 2
Prepare for those interviews like a pro! Research common questions related to healthcare AI evaluation and practice your responses. We can’t stress enough how important it is to showcase your expertise and experience confidently.
✨Tip Number 3
Don’t forget to tailor your approach! When applying through our website, make sure to highlight your relevant experience in healthcare and LLMs. We want to see how you fit into the role, so be specific about your skills.
✨Tip Number 4
Follow up after your application! A quick email to express your enthusiasm can go a long way. We love seeing candidates who are proactive and genuinely interested in the position.
We think you need these skills to ace Healthcare Services Admin Coordinator in London
Some tips for your application 🫡
Tailor Your Resume:Make sure your resume highlights your relevant experience in healthcare and any specific skills that match the job description. We want to see how your background aligns with what we're looking for!
Craft a Compelling Cover Letter:Use your cover letter to tell us why you're passionate about this role and how your expertise can contribute to our team. Be genuine and let your personality shine through!
Showcase Your Writing Skills:Since excellent writing is key for this position, consider including samples of your work or mentioning specific projects where you’ve communicated complex medical topics clearly. We love seeing your best work!
Follow Application Instructions:Make sure to complete all steps in the application process on our website. This includes uploading your resume and completing the AI interview. We review applications daily, so don’t miss out!
How to prepare for a job interview at Mercor
✨Know Your Stuff
Make sure you brush up on your healthcare knowledge, especially in the areas mentioned in the job description. Be ready to discuss your experience in clinical care, specialty medicine, or public health. This will show that you’re not just familiar with the field but have real-world expertise.
✨Showcase Your Writing Skills
Since excellent writing communication skills are a must-have, prepare to demonstrate your ability to explain complex medical topics clearly. Bring examples of your previous work, like articles or reports, that highlight your writing prowess and attention to detail.
✨Familiarise Yourself with LLMs
Given the role's focus on evaluating large language models, make sure you understand how they work and their applications in healthcare. Be prepared to discuss any relevant experience you have with model evaluation or data annotation, as this will set you apart from other candidates.
✨Prepare for Scenario-Based Questions
Expect to face scenario-based questions during the interview. Think about how you would evaluate LLM-generated responses in real-world healthcare situations. Practising these scenarios can help you articulate your thought process and demonstrate your problem-solving skills effectively.
