Senior Data Engineer

Senior Data Engineer

Full-Time 46090 - 49500 £ / year (est.) No working from home possible
HM TREASURY

At a Glance

  • Tasks: Design and build data pipelines to support major government projects worth over £1 trillion.
  • Company: Join NISTA, a dynamic team at the heart of UK government infrastructure reform.
  • Benefits: Enjoy 25 days annual leave, flexible working, and a generous pension scheme.
  • Other info: Collaborative culture with opportunities for professional development and innovation.
  • Why this job: Make a real impact on government delivery while growing your skills in a supportive environment.
  • Qualifications: Experience in data engineering, Python, and SQL is essential.

The predicted salary is between 46090 - 49500 £ per year.

Salary: London: £46,090 – £49,500. If the successful candidate is a current Civil Servant joining on level transfer, HM Treasury will honour their current substantive salary if higher. This role typically attracts a Government Digital and Data allowance of up to £6,000 for eligible individuals. Eligibility will be assessed following appointment via a capability assessment in line with the Digital and Data Capability Framework.

Contract Type: Permanent

Working Pattern: This post is available on a full time, part time or job share basis, and flexible working hours can be accommodated.

Location: London (1 Horse Guards Road). This post can be based in London (1 Horse Guards Road). Any applicants who are already NISTA staff can also apply to be based from their existing locations in Birmingham (23 Stephenson Street), or Leeds (2 Whitehall Quay).

About the Team NISTA: The Prime Minister has called for reform of the British state, seeking to go further and faster on renewal, and to ensure a more active government. To support these aims, the government has established the National Infrastructure and Service Transformation Authority (NISTA) as its centre of infrastructure expertise, harnessing the policy and strategy insight of the National Infrastructure Commission (NIC) and the delivery specialism of the Infrastructure and Projects Authority (IPA) and bringing them together to create a new, stronger and more powerful organisation capable of delivering these goals.

NISTA has six objectives:

  • Overseeing the government’s 10 Year Infrastructure Strategy
  • Identifying and coordinating infrastructure needs
  • Unblocking barriers and streamlining delivery of the government’s major projects
  • Setting standards and improving the government’s project delivery capabilities
  • Providing effective assurance for the government’s priority projects
  • Leading expertise on private finance

The NISTA Data & Insight Team brings together data scientists, engineers, analysts and digital professionals who genuinely care about learning from each other, sharing ideas and making things happen. Together we turn rich, high-value project data into analysis, insights and tools that support people across government, from project delivery teams to senior leaders in HMT, the Cabinet Office and No10, to make decisions that shape how the UK delivers its biggest and most complex projects.

Working with the Government Major Projects Portfolio, the 10-year Infrastructure Pipeline and other project delivery data, your work will directly influence how major programmes are planned, delivered and improved. Over the last two years, the team has undergone a significant transformation, digitising large-scale project data collection and overhauling our digital and data infrastructure. This enables us to create high-impact dashboards and analytics as well as drive the development of AI tools. It means we can develop and share quickly, resulting in rapid iterative development with our users. And we continue to evolve, improve our capability and develop our skills.

In this role, you’ll be joining a supportive, inclusive and collaborative environment, where you can grow your skills, tackle meaningful challenges and make a real impact on the future of government delivery.

About the Job: As a Senior Data Engineer in NISTA you will develop performant, reliable and secure data pipelines which help to inform senior leaders making decisions on projects worth in excess of £1tn. Working with subject matter experts, data scientists, and infrastructure engineers, you will ensure that data are relevant and processed effectively to enable products which meet the needs of our decision makers. You will use your technical skills to translate complex data needs into easily understood and well documented structures by utilising and developing the team’s mature cloud architecture and existing tooling. You will use a range of technical skills, deploying your existing data engineering toolkit as well as learning new techniques and experimenting to ensure you use the right tooling for the job. You will collaborate with a passionate team to promote a data-centric culture in the whole organisation, championing data engineering best practice in all your interactions with colleagues.

Key Responsibilities:

  • Design, build and evolve robust data pipelines used to extract, transform and load data from our collection platforms into our cloud-based environment.
  • Take ownership of the core data engineering tools that ensure our data is accurate, reliable and efficient to use.
  • Work closely with data scientists and infrastructure engineers to shape how data is collected and transformed, enabling high-quality analysis and insight.
  • Implement secure, well-governed change practices so back-end improvements can be delivered without disrupting production applications.
  • Create and maintain clear technical documentation so that our data infrastructure is transparent and easy to work with.
  • Act as a bridge between technical teams and non-technical stakeholders, clearly explaining data processes and helping others understand how data flows through the organisation.
  • Learning and experimenting to keep up-to-date with relevant new and innovative data tools and techniques.

About You: You will have experience of designing, coding, and testing resilient and maintainable solutions and will have contributed to the implementation of complex or large-scale data solutions. We would like you to have experience working in a multi-disciplinary data team to deliver and develop impactful data solutions as well as working in Python and/or SQL in a data engineering context.

Benefits:

  • 25 days annual leave (rising to 30 after 5 years), plus 8 public holidays and the King’s birthday (unless you have a legacy arrangement as an existing Civil Servant).
  • Additionally, we operate flexitime systems, allowing employees to take up to an additional 2 days off each month.
  • Flexible working patterns (part-time, job-share, condensed hours).
  • Generous parental and adoption leave packages.
  • Access to a generous Defined Benefit pension scheme with employer contributions of 28%.
  • Access to a cycle-to-work salary sacrifice scheme and season ticket advances.
  • A range of active staff networks, based around interests (e.g. analysts, music society, sports and social club) and diversity.

Senior Data Engineer employer: HM TREASURY

NISTA is an exceptional employer, offering a supportive and inclusive work culture that prioritises employee growth and development. With flexible working arrangements, generous leave policies, and a commitment to innovation in data engineering, you will have the opportunity to tackle meaningful challenges while making a significant impact on government projects worth over £1 trillion. Join a passionate team in the heart of London, where collaboration and continuous learning are at the forefront of our mission to enhance the UK's infrastructure capabilities.

HM TREASURY

Contact Details:

HM TREASURY Recruitment Team

We think you need these skills to ace Senior Data Engineer

Data Pipeline Development
Cloud Architecture
Data Engineering Toolkit
Python
SQL
Data Transformation
Technical Documentation