Principal Digital Specialist - Principal Data Engineer (Azure) in Dartford

Together we are Trusted to Serve Scotland.

Principal Data Engineer (Azure) We are seeking a Principal Data Engineer to join our Business Analytics team and lead the development of our cloud-based data platform. Our team’s mission is to turn data into actionable insights that support better decision‑making and deliver measurable value for the business. To enable this, we have built an Azure data platform built on lakehouse architecture. The platform leverages Fabric and Azure Databricks and provides a secure, governed and trusted foundation for our data. The platform offers a consistent and safe environment to develop, deploy and scale data products and AI/ML solutions, ensuring insights can be shared efficiently and used with confidence across the organisation. We are an ambitious team that uses data, advanced analytics and cloud technologies to design and deliver digital solutions that help colleagues drive improvements in key business areas, including asset management and water quality. We work closely with stakeholders through an inclusive and collaborative approach, ensuring we focus on the right problems and deliver outcomes that are genuinely useful. Our Business Analytics function brings together a strong pool of talent and provides excellent opportunities for learning, development and growth.

The role

As Principal Data Engineer, you will be the senior technical authority for data engineering in our organisation. This is a hands‑on leadership role with no direct line‑management duties, where you will set the standards and technical direction for our data engineering practice. You will guide the design and implementation of robust data pipelines and architectures on Azure, ensure high‑quality engineering outcomes through code reviews and mentoring, and spearhead innovation in tools and techniques. In this role, you will work closely with data scientists, solution developers, enterprise architects and platform engineers to ensure our data ecosystem is reliable, scalable and delivers value. You will also act as the key technical liaison with our external Digital partners, ensuring alignment with our standards and providing technical assurance on joint initiatives. This is a fantastic opportunity to shape the future of data engineering in a forward‑thinking, data‑driven organisation while staying at the forefront of industry developments.

What you will do

• Own and evolve data engineering standards and guiding technical principles across the Azure data analytics estate, acting as the technical authority for data engineering and ensuring high‑quality, well‑assured engineering outcomes.




• Gatekeep pull requests in Azure DevOps for changes to production data pipelines and lead the research and development of new tools, patterns and platform capabilities within the analytics environment.




• Design and assure technical designs for all projects on the Analytics platform and undertake hands‑on development for proof‑of‑concept work and complex technical initiatives.




• Collaboration is central to the role, working closely with analytics, data science, architecture and platform teams, as well as with the Platform Product Owner and Technical Support Team Lead to transition established solutions into support.

What you'll bring – Essential skills and experience

• Significant hands‑on experience as a senior or principal Data Engineer on Microsoft Azure, along with strong experience of modern Azure data platforms such as Azure Data Lake, Microsoft Fabric and Databricks.




• Proven ability to design and build scalable, secure data pipelines and lakehouse architectures, supported by strong programming skills, for example Python and SQL, with Spark experience desirable.




• Expertise working within DevOps CI/CD environments using Azure DevOps and a solid understanding of data quality, security and governance in regulated environments.




• Excellent communication skills are essential, along with the ability to influence through technical expertise.




• Desirable: experience with streaming or IoT data, familiarity with Infrastructure as Code, for example Terraform or Bicep, and Azure certifications.

Looking out for you

This is a full time (35 hours per week) role, but you’ll get plenty of time to recharge with 38 days of holiday every year (including public holidays). And you can even buy five more if you need a little extra time. You can also take paid time off to volunteer in your community. When it comes to major life events we have family‑friendly policies around adoption, maternity, and parental leave. And for the everyday? We embrace flexible working. For your future, there’s our pension (the ‘know‑what‑you’ll‑get‑when‑you‑retire’ kind), as well as life assurance. As for some nice extras? You can expect an annual company bonus. Not to mention access to SW Splash – handy rewards that can save you money on holidays, bills, and shopping.

The not‑so‑small print

This role will be a Grade 8 level. If you’re new to Scottish Water, you’ll join us on a salary between £54,776 - £74,386.

We operate Balanced Hybrid working at Scottish Water and we encourage people to work half their time in a Scottish Water location. Job offers at Scottish Water are conditional, and will be confirmed on completion of our pre‑employment screening, e.g. referencing, criminal record checks, license checks, etc. These checks are conducted on our behalf by a third party. Don’t worry – we’ll ask your permission before starting these checks.

Research shows that some people avoid applying for jobs unless they can meet every single criteria. If you’re interested in this job, but don’t tick all the boxes, apply anyway! We hardly ever hire people who can do every part of a job from Day One. Everyone has a learning curve. So don’t rule yourself out! Let us know if there are any changes we can make to our recruitment process to help you perform at your best.

Lots of our people have disabilities or neurodiverse conditions (including some of our recruiters!). We’re also aware that some people might be experiencing temporary challenges because of life events, like menopause. We’re very used to making adjustments, so please don’t be afraid to ask.

As part of our commitment to developing a flourishing Scotland, it’s important that all our employees are Scottish taxpayers. If you join us, your home address will need to be in Scotland. If you don’t already live here, you’ll need to commit to moving here within your first three months. Candidates should be aware that a valid UK driving licence is required for driving on Scottish Water business and claiming business mileage expenses. Please note Scottish Water takes the safety, health and wellbeing of our employees, colleagues and customers very seriously and as such you may be subject to Drug & Alcohol testing in line with our policy. Finally, candidates who haven’t submitted an application in the last 12 months will have their records removed from our recruitment database. You won’t need to do anything. Your data will be automatically deleted.

We’re here to help. Ask us anything at SWRecruitment@ScottishWater.co.uk

About Scottish Water

Together we are Trusted to Serve Scotland. Working at Scottish Water you'll be making a real difference to the lives of the people and communities in Scotland who rely on the vital water and waste water services we provide. We offer a broad range of career opportunities and our approach to inclusion and diversity means we can make a real difference together. Our people are essential to providing our customers with the very best service in communities around Scotland. We’re passionate about attracting, developing and retaining the best people who can make a positive difference to our business. If you are passionate about delivering a great customer service and can inspire trust and demonstrate pride in your work, we are confident that you will find Scottish Water a place where you can build on your talents and one where you can thrive.

If you would like to join our team at Scottish Water you can find out more about our latest vacancies here. Please note that candidates who have not submitted an application in the last 12 months will be automatically removed from our system records For further information on how Scottish Water manages your data, please see the Privacy Notice here: Data Protection - Recruitment Privacy Notice.