Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Build and maintain data pipelines to support groundbreaking health research.
- Company: Join Our Future Health, the UK's largest health research programme.
- Benefits: Competitive salary, generous pension, 30 days holiday, and wellbeing support.
- Why this job: Make a real impact on health research that benefits future generations.
- Qualifications: Experience in data engineering, health data, and proficiency in Python required.
- Other info: Flexible remote work options and a commitment to diversity and inclusion.
The predicted salary is between 74000 - 84000 £ per year.
Our Future Health will be the UK's largest ever health research programme, bringing people together to develop new ways to detect, prevent, and treat diseases. Diseases like cancer, dementia, diabetes, and heart disease affect the lives of many people in our communities. Our goal is to create a world-leading resource for health research, to improve our understanding and spot the patterns of how and why common diseases start, so treatments can begin sooner and be more effective. Our plan is to bring together 5 million volunteers from all across the UK who will be asked to contribute information to help build one of the most detailed pictures we have ever had of people's health. Researchers will be able to use this information to make new discoveries about human health and disease so future generations can live in good health for longer.
We are looking for a Senior Data Engineer to bring an in-depth knowledge of health and survey data and data solutions to help solve some of the key challenges around a programme of work at industrial scale with global significance.
Responsibilities- Write and contribute code to a complex code base responsible for delivering data to researchers on an industrial scale.
- Work with health records to build pipelines and systems to process it, control quality and create data releases for researchers.
- Support the build of data pipelines from data providers to our primary data store and trusted research environment.
- Produce logic for data transformation steps as code, which meets the requirements for our end users and builds well-curated, accessible and quality-controlled data for analysis.
- Contribute to code base for multiple data pipelines while ensuring best coding practices are used.
- Work with data scientists and epidemiologists to understand the data requirements and deliver the data needed for their projects.
- Keep abreast of best practice in data engineering across industry, research and government and facilitate the adoption of standards.
- Experience building and maintaining robust, scalable and efficient data pipelines.
- Can listen to the needs of technical and business stakeholders and interpret them, effectively managing stakeholder expectations.
- Experience working with health data (ideally NHS or survey/questionnaire data).
- Experience with secondary care datasets (Hospital Episodes Statistics, Death registry data, A&E data, etc.) as well as Primary care (GP data) would be advantageous.
- Experience with survey/questionnaire data and standards (REDCap) would be advantageous.
- Highly proficient in Python with solid command line knowledge and Unix skills.
- Good understanding of cloud environments (ideally Azure), distributed computing and optimisation of workflows and pipelines.
- Understanding of common data transformation and storage formats, e.g. Apache Parquet, Delta tables.
- Understanding of containerisation (e.g. Docker) and deployment (e.g. Kubernetes).
- Experience with Spark, Databricks, data lakes.
- Follow best practices like code review, clean code and unit tests.
- Experience working in an agile development team.
- Familiar with version control and Git/GitHub.
- Awareness of data standards such as GA4GH and FAIR.
- Salary from £74,000.
- Generous Pension Scheme – employer contributions of up to 12%.
- 30 days holiday pro-rated + bank holidays.
- Enhanced parental leave.
- Cycle to Work Scheme – save 25–39% on a new bike and accessories through salary sacrifice.
- Home & tech savings – up to 8% off on IKEA and Currys products, spread over 12 months through salary sacrifice.
- £1,000 Employee Referral Bonus.
- Wellbeing support – access to Mental Health First Aiders, 24/7 online GP services and an Employee Assistance Programme.
- A great place to work – central London office in Holborn with flexible and remote working arrangements.
You may work remotely from anywhere within the UK, with occasional travel to London. Closing date for applications: 12th November. We recommend you apply as soon as possible as occasionally due to high volumes of applications, we need to close our postings early. At Our Future Health, we recognise the importance of having a diverse workforce and ensuring that all candidates, regardless of their background, have equitable access to our application process. We proactively encourage applicants who identify as having a disability, neurodiversity, or long-term health conditions to let us know if they require any reasonable adjustments as part of their application process. If you do require any reasonable adjustments, please email us at talent@ourfuturehealth.org.uk.
Senior Data Engineer in City of London employer: Our Future Health UK
Contact Detail:
Our Future Health UK Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer in City of London
✨Tip Number 1
Network like a pro! Reach out to people in the industry, attend meetups, and connect with professionals on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your data engineering projects, especially those related to health data. This will give potential employers a taste of what you can do and set you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering questions and scenarios. Practice explaining your thought process and how you tackle challenges, especially those relevant to health data and pipeline management.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Senior Data Engineer in City of London
Some tips for your application 🫡
Tailor Your Application: Make sure to customise your CV and cover letter to highlight your experience with health data and data engineering. We want to see how your skills align with our mission at Our Future Health!
Showcase Your Technical Skills: Don’t hold back on detailing your proficiency in Python, cloud environments, and data pipelines. We’re looking for someone who can hit the ground running, so let us know what you’ve got!
Be Clear and Concise: When writing your application, keep it straightforward. Use clear language to explain your past experiences and how they relate to the role. We appreciate a well-structured application that’s easy to read.
Apply Early!: We recommend applying as soon as possible since we might close the application process early due to high volumes. Head over to our website and get your application in – we can’t wait to hear from you!
How to prepare for a job interview at Our Future Health UK
✨Know Your Data Inside Out
Make sure you brush up on your knowledge of health and survey data, especially NHS datasets. Be prepared to discuss how you've built and maintained data pipelines in the past, and think about specific examples that showcase your experience with secondary care datasets.
✨Showcase Your Coding Skills
Since this role requires a solid command of Python and familiarity with coding best practices, be ready to demonstrate your coding abilities. You might even want to prepare a small coding challenge or example project to discuss during the interview.
✨Understand Stakeholder Needs
This position involves working closely with both technical and business stakeholders. Think about how you've effectively managed stakeholder expectations in previous roles and be ready to share those experiences. Highlight your communication skills and how you translate technical jargon into layman's terms.
✨Stay Current with Industry Standards
Familiarise yourself with the latest trends and best practices in data engineering, especially around health data. Be prepared to discuss how you keep up-to-date with industry standards like GA4GH and FAIR, and how you would facilitate their adoption in your work.
