AI Evaluation SME Quality Expert

Elsevier's Evaluation Operations group supports Health Markets and Research product teams by recruiting, onboarding, and managing large networks of SMEs. We partner with product managers, clinical leaders, data scientists, UX researchers, legal, and procurement to deliver reliable, compliant, and scalable evaluation capacity. Our focus is measurable quality, transparent processes, and a great SME experience.

We are seeking a Senior Eval Program Expert to own SME lifecycle operations from requirements gathering through quality oversight and continuous improvement. You will collaborate with evaluation domain leads to define project specifications, implement consistent quality procedures, and ensure audit-ready documentation. You will set SME performance standards, run calibration and inter-rater reliability activities, and drive process improvements. Your work ensures experts are engaged with clear expectations, efficient workflows, and consistent results.

Responsibilities

• SME Requirements Gathering and Planning
  • Collaborate with evaluation domain leads to collect and document SME requirements by activity type and timeline.
  • Translate evaluation needs into clear SME profiles, sourcing plans, and staffed project specifications.
  • Maintain proactive communication with stakeholders to forecast capacity and mitigate risks.
• SME Quality Oversight and Evaluation Activity Management
  • Implement quality assurance procedures for SME work, including calibration sessions and inter-rater reliability measurement.
  • Monitor performance, provide structured feedback, and implement corrective actions where needed.
  • Track SME activity completion, invoicing, and payments in partnership with Finance and Procurement.
  • Develop quality dashboards and regular reports for stakeholder visibility.
• Process Documentation and Continuous Improvement
  • Maintain SOPs, templates, checklists, and playbooks for project readiness and quality management.
  • Drive improvements that increase throughput, reduce cycle time, and improve SME experience.
  • Maintain audit-ready, version-controlled documentation and ensure compliance with privacy and procurement policies.
• SME Relationship Management
  • Build and nurture ongoing relationships with SME communities across specialties and domains.
  • Coordinate cross-functional collaboration with HR, Tech, Legal, and Evaluation leads.
  • Ensure SMEs receive ongoing support, training updates, and clear communication on SOPs, tools, and rater guidance.

Requirements

• Bachelor's degree in Business Administration, Operations Management, Human Resources, Information Science, Public Health, or related field.
• 3 to 5 years in operations, program management, or quality assurance, ideally in healthcare or research settings.
• Experience with project management platforms and workflow tools.
• Proven ability to produce clear SOPs, training materials, and documentation for technical and non-technical audiences.
• Strong organization and program management across multiple concurrent projects and deadlines.
• Quality management expertise, including calibration facilitation and inter-rater reliability fundamentals.
• Excellent written and verbal communication with strong stakeholder management skills.
• Experience in process improvement and scaling operations; proficiency in Excel or Google Sheets.
• Working knowledge of privacy and compliance in healthcare and research such as HIPAA and GDPR fundamentals.
• Comfortable coordinating with evaluation domain leads and technical teams to drive operational excellence.

Preferred Qualifications

• Experience working with SMEs or external contractor networks at scale.
• Background in quality assurance or quality management systems.
• Familiarity with evaluation or assessment operations.
• Experience with vendor management, invoice reconciliation, and basic budgeting.
• Project management training or certification (PMP, Lean Six Sigma, or similar).

We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.

Flexible working hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.

We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:

• Comprehensive Pension Plan
• Home, office, or commuting allowance.
• Generous vacation entitlement and option for sabbatical leave
• Maternity, Paternity, Adoption and Family Care leave
• Flexible working hours
• Personal Choice budget
• Internal communities and networks
• Various employee discounts
• Recruitment introduction reward
• Employee Assistance Program (global)

As a global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education, and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.