Diabetes Specialist Nurse for AI Chatbot Evaluation Project (UK)
Diabetes Specialist Nurse for AI Chatbot Evaluation Project (UK)

Diabetes Specialist Nurse for AI Chatbot Evaluation Project (UK)

Full-Time 13 - 16 £ / hour (est.) No home office possible
Mentis AI

At a Glance

  • Tasks: Evaluate and improve a diabetes-specific AI chatbot by reviewing transcripts and scoring responses.
  • Company: Join a forward-thinking team focused on healthcare innovation.
  • Benefits: Enjoy flexible remote work, competitive pay, and professional development opportunities.
  • Why this job: Make a real impact in diabetes care while working with cutting-edge AI technology.
  • Qualifications: Must have at least 1 year of clinical experience managing diabetic patients.
  • Other info: Gain valuable skills in AI evaluation and health informatics.

The predicted salary is between 13 - 16 £ per hour.

We are seeking specialist diabetic nurses to help evaluate and improve a diabetes-specific AI chatbot. You will work asynchronously, reviewing de-identified chatbot transcripts and scoring the chatbot's responses using standardised Likert-scale metrics.

Key Responsibilities

  • Transcript Review & Evaluation: Review 20–25 chatbot transcripts (500–700 words each), assessing the quality and clinical appropriateness of the chatbot's responses to simulated diabetes-related patient interactions.
  • Likert-Scale Scoring: Rate each transcript across the following evaluation dimensions using a standardised scoring form:
  • Factuality: Accuracy and correctness of the information provided.
  • Safety Compliance: Absence of harmful, misleading, or unsafe guidance.
  • Bias: Presence or absence of unjustified differential treatment, stereotypes, or assumptions.
  • Completeness: Adequacy and thoroughness of the response relative to the case history.
  • Tone: Appropriateness, respectfulness, and clarity of communication.
  • Gold Standard Creation: Your evaluations will serve as the foundation for establishing gold-standard benchmarks for this chatbot's performance, directly shaping future model improvements.
  • Qualifications

    • Clinical experience: Minimum 1 year experience managing diabetic patients.
    • Domain knowledge: Familiarity with evidence-based diabetes care protocols, patient education, and clinical best practices for diabetes management.
    • Language: Professional working English for written deliverables.
    • Relevant skills: The ideal candidate is comfortable evaluating clinical content for accuracy, safety, and appropriateness, and can apply clinical judgement to assess AI-generated health guidance in a diabetes context.

    Legal Status

    You will have the right to work in your country of residence. You will work as an independent contractor.

    Why Join Us?

    • Flexible Work Arrangements: Fully remote and asynchronous.
    • Competitive Compensation: Hourly compensation in line with level of clinical experience.
    • Professional Development: Gain hands-on experience in AI evaluation, data quality, and health informatics, with training provided on scoring methodologies.

    Diabetes Specialist Nurse for AI Chatbot Evaluation Project (UK) employer: Mentis AI

    Join a forward-thinking organisation that values innovation and flexibility, offering fully remote work arrangements for our Diabetes Specialist Nurse role. With competitive compensation and opportunities for professional development in AI evaluation and health informatics, you will play a crucial role in shaping the future of diabetes care while enjoying a supportive and collaborative work culture.
    Mentis AI

    Contact Detail:

    Mentis AI Recruiting Team

    StudySmarter Expert Advice 🤫

    We think this is how you could land Diabetes Specialist Nurse for AI Chatbot Evaluation Project (UK)

    ✨Tip Number 1

    Network like a pro! Reach out to fellow nurses or professionals in the diabetes care field. Join online forums or social media groups where you can connect with others who might have insights or leads on opportunities, including our own openings.

    ✨Tip Number 2

    Show off your expertise! When you get the chance to chat with potential employers, highlight your clinical experience and familiarity with diabetes management. Make sure they know you’re the go-to person for evaluating AI-generated health guidance.

    ✨Tip Number 3

    Prepare for interviews by brushing up on the latest in diabetes care and AI technology. Be ready to discuss how you can contribute to improving our chatbot’s performance based on your clinical judgement and experience.

    ✨Tip Number 4

    Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, you’ll find all the details about the role and what we’re looking for in candidates like you.

    We think you need these skills to ace Diabetes Specialist Nurse for AI Chatbot Evaluation Project (UK)

    Clinical Experience in Diabetes Management
    Transcript Review and Evaluation
    Standardised Likert-Scale Scoring
    Factual Accuracy Assessment
    Safety Compliance Evaluation
    Bias Detection
    Completeness Assessment
    Tone Appropriateness Evaluation
    Clinical Judgement Application
    Evidence-Based Diabetes Care Knowledge
    Patient Education Expertise
    Health Informatics Familiarity
    Professional Working English

    Some tips for your application 🫡

    Show Off Your Experience: Make sure to highlight your clinical experience with diabetic patients. We want to see how your background aligns with the role, so don’t hold back on sharing relevant examples!

    Be Clear and Concise: When writing your application, keep it straightforward. Use professional language but also make it easy for us to read. We appreciate clarity, especially when it comes to your qualifications and skills.

    Tailor Your Application: Don’t just send a generic application! Tailor it to the specifics of the job description. Mention your familiarity with evidence-based diabetes care protocols and how you can contribute to evaluating the AI chatbot.

    Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity!

    How to prepare for a job interview at Mentis AI

    ✨Know Your Stuff

    Brush up on your diabetes knowledge and clinical best practices. Be ready to discuss specific protocols and how they apply to the evaluation of AI-generated responses. This will show that you’re not just familiar with the subject but also passionate about improving patient care.

    ✨Familiarise Yourself with the Evaluation Criteria

    Make sure you understand the Likert-scale metrics you'll be using to score the chatbot's responses. Practise evaluating sample transcripts if possible, so you can demonstrate your ability to assess factuality, safety compliance, and tone during the interview.

    ✨Showcase Your Clinical Judgement

    Prepare examples from your experience where you've had to make clinical decisions or evaluate patient interactions. This will help illustrate your ability to apply clinical judgement when assessing AI-generated health guidance.

    ✨Ask Insightful Questions

    Come prepared with questions about the project and the role. Inquire about the training provided for scoring methodologies or how your evaluations will impact the chatbot's development. This shows your genuine interest in the position and the company's mission.

    Diabetes Specialist Nurse for AI Chatbot Evaluation Project (UK)
    Mentis AI

    Land your dream job quicker with Premium

    You’re marked as a top applicant with our partner companies
    Individual CV and cover letter feedback including tailoring to specific job roles
    Be among the first applications for new jobs with our AI application
    1:1 support and career advice from our career coaches
    Go Premium

    Money-back if you don't land a job in 6-months

    >