Clinical Data Engineer

The Clinical Data Engineer will be instrumental in driving the Health Data Institute's mission to leverage data for improved healthcare outcomes. Collaborating with the Principal Data Scientist, Head of Data Science & Advanced Analytics, multidisciplinary teams and Industry Partners, the Clinical Data Engineer will design, build, and operationalise robust data engineering and AI solutions that power advanced analytics and AI initiatives across the Trust and beyond. This position requires strong technical capability in SQL, data pipeline architecture, statistical analysis, machine learning, and predictive analytics, combined with a sound understanding of clinical and operational environments.

The Clinical Data Engineer will be responsible for developing high-quality health datasets, enhancing data infrastructure, and advising internal teams on best practices in data engineering and analytics. As a technical lead and trusted advisor, the Clinical Data Engineer will help curate bespoke datasets for Advanced Analytics, design and develop AI solutions, shape AI policy, support service innovation, and ensure all solutions align with the Trust's Digital Strategy. The ultimate goal is to turn complex data into actionable insights and tools that strengthen patient care, improve operational efficiency, and inform strategic decisions.

Main duties of the job

• Design, develop, and operationalise data engineering and AI solutions to support research, clinical care, and operational performance across the Trust.
• Lead the adoption of best practices, develop automated data pipelines, and implement secure, scalable solutions using SQL, Python, R, and cloud technologies.
• Build predictive and prescriptive models, deploying and monitoring machine learning applications, and applying advanced analytics to improve patient outcomes, service efficiency, and workforce wellbeing.
• Collaborate with internal teams and external partners, contributing to the Trust's Secure Data Environment and Federated Data Platform, ensuring all work complies with ethical, legal, and governance standards.
• Manage data research projects, guide stakeholders, and promote adoption of analytics insights to support service transformation.
• Translate complex technical concepts into actionable recommendations, facilitate workshops and training, and support strategic decision‑making across clinical, operational, and executive teams.

About us

Diversity makes us interesting... Inclusion is what will make us outstanding. Inequality exists and the journey to eliminate it is not easy. Every step we take will be a purposeful step forward to deliver a truly inclusive culture where all our people are enabled to deliver outstanding care, where background is no barrier, and where everyone can be their authentic self and we truly represent our patient community. We are committed to equal opportunities and welcome applications from all sections of the community, regardless of any protected characteristics. Reasonable adjustments will be made for disabled applicants where possible. All applicants who have a disability and meet the minimum criteria for the post can opt for a guaranteed interview.

If you need additional help with your application please get in touch by calling the recruitment team on 0118 322 6997 or 0118 322 5342. Our primary method of communication will be via email. However, if you would prefer to be contacted through a different method, please inform the recruitment team.

Job responsibilities

• Design, build, and maintain automated, scalable, and secure data pipelines for ingestion, cleaning, transformation, and integration of diverse health datasets.
• Optimise infrastructure to support analytics, machine learning, and clinical decision support.
• Implement open‑source, cost‑effective, and cloud‑based solutions where appropriate.
• Contribute to the Trusts Secure Data Environment and Federated Data Platform for population health and research.
• Develop and operationalise models to address clinical, operational, and research priorities.
• Apply modern approaches, including machine learning, NLP, and deep learning, to extract insights.
• Support deployment into Trust systems, ensuring safe integration with clinical workflows.
• Monitor models post‑deployment, updating for accuracy, fairness, and compliance.
• Ensure all work complies with NHS standards for data protection, confidentiality, and security.
• Promote ethical AI, transparency, and avoidance of algorithmic bias.
• Work with clinicians, IT, BI, research, and operational colleagues to translate healthcare needs into data solutions.
• Partner with external organisations including NHS hubs, academic institutions, and industry collaborators.
• Communicate technical findings to diverse audiences, tailoring language to non‑specialists.
• Identify and implement opportunities to improve services, patient outcomes, and workforce wellbeing through data.
• Act as SME for data engineering and AI within the HDI.
• Mentor analysts, scientists, and placement students in reproducible and code‑based approaches.
• Plan, manage, and deliver projects from scoping to delivery, applying Agile principles where appropriate.
• Engage regularly with internal and external stakeholders, including Arcturis, Thames Valley AI Hub, Informatics Research Centre, and University of Reading.
• Support development and delivery of HDI strategy, aligning with national and regional priorities.

Knowledge, Skills & Experience

• Degree in Computer Science, Data Science, Statistics, Engineering, or equivalent.
• Proficiency in Python, SQL, ETL, APIs, and cloud platforms (AWS/Azure/GCP).
• Knowledge of ML algorithms, operationalisation, and model monitoring.
• Strong understanding of governance, security, and ethical frameworks in health data.
• Excellent communication, influencing, and negotiation skills.
• Experience delivering complex projects and mentoring others.

Desirable

• Postgraduate qualification (MSc/PhD) in data science, ML, or related subject.
• Experience with health data standards (HL7, FHIR, SNOMED).
• Familiarity with NHS datasets and national initiatives.
• Experience with BI tools such as Power BI, Tableau, or Looker.
• Research track record with academic or industry partners.

Analytical & Judgement Skills

• Applies advanced methods to large and complex datasets.
• Evaluates competing methodologies and balances rigour with operational relevance.
• Anticipates and mitigates risks such as bias or unintended consequences.
• Exercises independent judgement in situations of incomplete or conflicting evidence.

Physical, Mental & Emotional Effort

• Primarily desk‑based role requiring long periods of concentration at a computer.
• Occasional movement of equipment and travel between sites.
• Frequent requirement for sustained focus when coding or problem‑solving.
• Occasional exposure to sensitive or distressing data.
• Requirement to manage expectations and deliver contentious findings with diplomacy.

Working Conditions

• Office and hybrid working, with flexibility subject to Trust policy.
• Use of VDUs for prolonged periods.
• Occasional regional/national travel to meetings and conferences.
• Collaborative, multi‑disciplinary working across healthcare, academia, and industry.

Professional Development

• Active engagement in CPD and knowledge‑sharing.
• Completion of all mandatory training.
• Participation in appraisal and development planning.
• Contribution to training and mentoring of colleagues.

Equality, Diversity & Inclusion

• Promote fairness, inclusion, and respect in all activities.
• Ensure solutions are designed and tested for equity and bias reduction.
• Contribute to a positive and inclusive team culture.

Health & Safety

• Take responsibility for own health, safety, and wellbeing.
• Report incidents and hazards promptly.
• Ensure safe use of equipment and promote a culture of safety across the team.

Other Duties

• Provide cover during periods of absence or peak demand.
• Support additional projects and initiatives relevant to the role.
• Maintain awareness of and compliance with Trust policies.
• Contribute to continuous service improvement in line with Trust priorities.

Person Specification

• BSc - Data, Mathematical or Medically related field
• MSc - Data, Mathematical or Medically related field
• Project Management Qualification (e.g. PRINCE2)

Experience

• Minimum 3 years in a Data related field
• Proficiency in SQL
• Proficiency in Python (Machine Learning, Deep Learning or LLM Frameworks)
• Minimum 2 years experience in Data related field
• Minimum 2 years in a Business or Management Consulting field
• Experience of Docker, Hadoop, PySpark, Apache or MS Azure
• Minimum 2 years NHS/Healthcare experience

Disclosure and Barring Service Check

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.