At a Glance
- Tasks: Develop evaluation frameworks for AI in clinical operations and global development.
- Company: Join a leading pharma company at the forefront of generative AI technology.
- Benefits: Competitive salary, annual bonuses, generous leave policies, and wellness programmes.
- Other info: Collaborate with experts and enjoy excellent career growth opportunities.
- Why this job: Make a real impact by ensuring AI quality in clinical settings.
- Qualifications: PhD or equivalent experience in clinical, biomedical, or related fields.
The predicted salary is between 40100 - 63595 £ per year.
About the Role
We are deploying generative AI agents across clinical operations and global development workflows: clinical data review, anomaly detection in trial data, protocol Q&A for site teams, Informed Consent Form generation and translation, and protocol element document assembly. Each system requires rigorous evaluation. In specialized clinical contexts, "good" is not a single number. It depends on the user, the regulatory context, the therapeutic area, and the cost profile of errors. We are looking for a postdoctoral researcher to develop evaluation frameworks, rubrics, and quality systems that determine when these AI agents are ready for our scientists, clinical operations specialists, and site teams to rely on.
Key Responsibilities
- Develop evaluation frameworks and rubrics for AI agents operating in clinical operations and global development contexts.
- Define quality dimensions for specialized outputs, e.g. clinical data queries, anomaly detection, protocol Q&A responses, ICF content, regulatory documents, that reflect how clinical‑ops users actually judge quality.
- Design and run human evaluation protocols with clinical, regulatory, and site‑facing subject matter experts.
- Build benchmark datasets and evaluation pipelines that the broader GenAI organization uses across AI applications.
- Partner with our AI engineering teams to translate evaluation findings into measurable improvement.
- Contribute to the methodology of how a regulated pharma organization evaluates AI in clinical work.
What We're Looking For
Domain Expertise
- Strong understanding of clinical operations and global development workflows, e.g. clinical data management, monitoring, regulatory documentation, site operations, or related areas.
- Familiarity with how clinical‑ops specialists, monitors, regulatory authors, and site teams actually do their work and assess quality.
- PhD or equivalent research experience in a clinical, biomedical, regulatory, biostatistics, or closely related field.
Enthusiasm for AI agents
- Genuine interest in working hands‑on with generative AI and agentic systems.
- Curiosity about how LLMs behave in specialized domains and where they fail.
- Comfort prototyping with modern AI tooling (LLM APIs, vector databases, evaluation frameworks).
Aptitude for evaluation systems
- Demonstrated ability to develop frameworks, rubrics, and structured assessment protocols.
- Experience designing evaluations with multiple quality dimensions, expert raters, or non‑trivial inter‑rater reliability considerations.
- Strong analytical and writing skills; comfort with ambiguity and unsolved problems.
Practical Skills
- Python and the modern ML/data stack.
- Comfort working across disciplines, e.g. clinical operations, regulatory affairs, AI engineering, data science.
Practical Details
- Duration: 2‑year postdoctoral appointment.
- Reports to: [TBD].
- Works closely with Generative AI Teams, Scientific Fellow, clinical operations and regulatory subject matter experts across J&J global development.
Pay Range
€60,000 – €96,255 (primary posting location). Additional ranges: UK – GBP 40,100 to 63,595; Switzerland – CHF 93,500 to 149,615; USA – USD 79,000 to 127,650; Spain – EUR 43,600 to 70,150.
Benefits
In addition to base pay, we offer an annual bonus based on pay grade and location, vacation days, parental leave (minimum 12 weeks), bereavement leave, caregiver leave, volunteer leave, well‑being reimbursement, programs for financial, physical and mental health, service anniversary awards, and insurance plans.
This is for informative purposes only. Amounts and actual benefits may vary by location and are subject to change.
Post Doctoral Researcher, Evaluation & Standards in Clinical Operations in High Wycombe employer: Johnson & Johnson Innovative Medicine
At Johnson & Johnson, we pride ourselves on being an exceptional employer, particularly for those in the field of clinical operations and AI research. Our collaborative work culture fosters innovation and growth, providing ample opportunities for professional development while working on cutting-edge generative AI projects that have a real impact on healthcare. With comprehensive benefits, including generous parental leave and well-being programmes, we ensure our employees are supported both personally and professionally in our dynamic global environment.
Contact Details:
Johnson & Johnson Innovative Medicine Recruitment Team
StudySmarter Expert Advice🤫
We think this is how you could land Post Doctoral Researcher, Evaluation & Standards in Clinical Operations in High Wycombe
✨Tip Number 1
Network like a pro! Reach out to professionals in clinical operations and AI through LinkedIn or industry events. A friendly chat can open doors that applications alone can't.
✨Tip Number 2
Show off your skills! Prepare a portfolio showcasing your evaluation frameworks or any relevant projects. This gives you a chance to demonstrate your expertise beyond just your CV.
✨Tip Number 3
Practice makes perfect! Conduct mock interviews with friends or mentors, focusing on your understanding of clinical workflows and AI. The more comfortable you are, the better you'll perform.
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets noticed. Plus, it shows you're genuinely interested in joining our team at StudySmarter.
We think you need these skills to ace Post Doctoral Researcher, Evaluation & Standards in Clinical Operations in High Wycombe
Some tips for your application 🫡
Tailor Your Application:Make sure to customise your CV and cover letter to highlight your experience in clinical operations and AI. We want to see how your background aligns with the role, so don’t hold back on showcasing relevant projects or research!
Show Your Passion for AI:Let us know why you’re excited about working with generative AI in clinical contexts. Share any hands-on experiences you've had with AI tools or projects, as this will help us see your enthusiasm and fit for the role.
Highlight Your Evaluation Skills:Since the role focuses on developing evaluation frameworks, be sure to emphasise your analytical skills and any previous work you've done in creating assessment protocols. We love seeing concrete examples of your expertise!
Apply Through Our Website:Don’t forget to submit your application through our website! It’s the best way for us to receive your materials and ensure they get into the right hands. Plus, it shows you’re serious about joining our team!
How to prepare for a job interview at Johnson & Johnson Innovative Medicine
✨Know Your Stuff
Make sure you have a solid understanding of clinical operations and global development workflows. Brush up on how clinical data management, regulatory documentation, and site operations work. This knowledge will help you answer questions confidently and show that you're the right fit for the role.
✨Show Your AI Enthusiasm
Demonstrate your genuine interest in generative AI and agentic systems during the interview. Share any hands-on experience you've had with AI tooling or projects. This will highlight your passion and make you stand out as a candidate who is excited about the future of AI in clinical settings.
✨Prepare Evaluation Frameworks
Since the role involves developing evaluation frameworks and rubrics, come prepared with examples of how you've approached similar tasks in the past. Discuss your thought process and any challenges you faced. This will showcase your analytical skills and ability to tackle complex problems.
✨Ask Insightful Questions
Prepare thoughtful questions about the company's use of AI in clinical operations and how they evaluate these systems. This shows your curiosity and engagement with the role. It also gives you a chance to assess if the company aligns with your career goals and interests.
