At a Glance
- Tasks: Evaluate and improve a diabetes-specific AI chatbot by reviewing transcripts and scoring responses.
- Company: Join a forward-thinking team focused on healthcare innovation.
- Benefits: Enjoy flexible remote work, competitive pay, and professional development opportunities.
- Why this job: Make a real impact in diabetes care while working with cutting-edge AI technology.
- Qualifications: Must have at least 1 year of clinical experience managing diabetic patients.
- Other info: Gain valuable skills in AI evaluation and health informatics.
The predicted salary is between 13 - 16 £ per hour.
We are seeking specialist diabetic nurses to help evaluate and improve a diabetes-specific AI chatbot. You will work asynchronously, reviewing de-identified chatbot transcripts and scoring the chatbot's responses using standardised Likert-scale metrics.
Key Responsibilities
- Transcript Review & Evaluation: Review 20–25 chatbot transcripts (500–700 words each), assessing the quality and clinical appropriateness of the chatbot's responses to simulated diabetes-related patient interactions.
- Likert-Scale Scoring: Rate each transcript across the following evaluation dimensions using a standardised scoring form:
- Factuality: Accuracy and correctness of the information provided.
- Safety Compliance: Absence of harmful, misleading, or unsafe guidance.
- Bias: Presence or absence of unjustified differential treatment, stereotypes, or assumptions.
- Completeness: Adequacy and thoroughness of the response relative to the case history.
- Tone: Appropriateness, respectfulness, and clarity of communication.
Qualifications
- Clinical experience: Minimum 1 year experience managing diabetic patients.
- Domain knowledge: Familiarity with evidence-based diabetes care protocols, patient education, and clinical best practices for diabetes management.
- Language: Professional working English for written deliverables.
- Relevant skills: The ideal candidate is comfortable evaluating clinical content for accuracy, safety, and appropriateness, and can apply clinical judgement to assess AI-generated health guidance in a diabetes context.
Legal Status
You will have the right to work in your country of residence. You will work as an independent contractor.
Why Join Us?
- Flexible Work Arrangements: Fully remote and asynchronous.
- Competitive Compensation: Hourly compensation in line with level of clinical experience.
- Professional Development: Gain hands-on experience in AI evaluation, data quality, and health informatics, with training provided on scoring methodologies.
Diabetes Specialist Nurse for AI Chatbot Evaluation Project (UK) employer: Mentis AI
Contact Detail:
Mentis AI Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Diabetes Specialist Nurse for AI Chatbot Evaluation Project (UK)
✨Tip Number 1
Network like a pro! Reach out to fellow nurses or professionals in the diabetes care field. Join online forums or social media groups where you can connect with others who might have insights or leads on opportunities, including our own openings.
✨Tip Number 2
Show off your expertise! When you get the chance to chat with potential employers, highlight your clinical experience and familiarity with diabetes management. Make sure they know you’re the go-to person for evaluating AI-generated health guidance.
✨Tip Number 3
Prepare for interviews by brushing up on the latest in diabetes care and AI technology. Be ready to discuss how you can contribute to improving our chatbot’s performance based on your clinical judgement and experience.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, you’ll find all the details about the role and what we’re looking for in candidates like you.
We think you need these skills to ace Diabetes Specialist Nurse for AI Chatbot Evaluation Project (UK)
Some tips for your application 🫡
Show Off Your Experience: Make sure to highlight your clinical experience with diabetic patients. We want to see how your background aligns with the role, so don’t hold back on sharing relevant examples!
Be Clear and Concise: When writing your application, keep it straightforward. Use professional language but also make it easy for us to read. We appreciate clarity, especially when it comes to your qualifications and skills.
Tailor Your Application: Don’t just send a generic application! Tailor it to the specifics of the job description. Mention your familiarity with evidence-based diabetes care protocols and how you can contribute to evaluating the AI chatbot.
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity!
How to prepare for a job interview at Mentis AI
✨Know Your Stuff
Brush up on your diabetes knowledge and clinical best practices. Be ready to discuss specific protocols and how they apply to the evaluation of AI-generated responses. This will show that you’re not just familiar with the subject but also passionate about improving patient care.
✨Familiarise Yourself with the Evaluation Criteria
Make sure you understand the Likert-scale metrics you'll be using to score the chatbot's responses. Practise evaluating sample transcripts if possible, so you can demonstrate your ability to assess factuality, safety compliance, and tone during the interview.
✨Showcase Your Clinical Judgement
Prepare examples from your experience where you've had to make clinical decisions or evaluate patient interactions. This will help illustrate your ability to apply clinical judgement when assessing AI-generated health guidance.
✨Ask Insightful Questions
Come prepared with questions about the project and the role. Inquire about the training provided for scoring methodologies or how your evaluations will impact the chatbot's development. This shows your genuine interest in the position and the company's mission.