About usLead Data Engineer (Databricks)River Water Quality ProgrammeWarrington (Hybrid – 3 days onsite per week)At United Utilities, we’re committed to protecting the environment that millions of people depend on every day. As part of our Digital Services team, you’ll play a pivotal role in one of our most important and high-impact initiatives: near real time monitoring of river water quality.We’re looking for a Lead Data Engineer to take technical ownership of modern, scalable data platforms that turn complex environmental and telemetry data into trusted insights for regulators, scientists, and operational teams.What you’ll be doingAs the Lead Data Engineer on our River Water Quality Programme, you’ll design, build, and optimise Databricks-based data pipelines that enable timely, reliable and well-governed data across the organisation.You’ll:Design and develop scalable batch and streaming data pipelines using Databricks, Spark and Delta LakeImplement medallion architecture (bronze/silver/gold) to ensure data quality, lineage and efficient consumptionOptimise Spark jobs and workflows to meet near real-time monitoring SLAsBuild and maintain streaming pipelines using Structured Streaming and Delta Live TablesEnsure strong data governance, including schema enforcement, validation rules and ACID complianceOrchestrate and automate pipelines using Databricks Jobs, APIs or cloud-native schedulersCollaborate with data scientists, analysts and environmental specialists to deliver high-quality, well-documented datasetsMonitor, troubleshoot and continuously improve production pipelines for reliability, performance and cost efficiencyChampion best practices across CI/CD, testing, version control and documentationAct as a technical leader and mentor, raising standards across the data engineering communityWhat you’ll bringEssentialDeep expertise in Databricks (Spark / PySpark, Delta Lake, Unity Catalog, Workflows)Strong experience building ETL/ELT pipelines, both batch and streamingAdvanced Python and SQL skillsHands-on experience with cloud platforms (Azure, AWS or GCP)Solid understanding of data modelling and modern architecturesStrong knowledge of data governance, security and complianceDesirableExperience with orchestration tools such as AirflowFamiliarity with CI/CD pipelines, Git workflows and automated testingExposure to real-time, IoT or environmental telemetry dataExperience & QualificationsBachelor’s degree in Computer Science, Data Engineering or a related discipline5+ years’ experience in data engineering roles, including 3+ years with DatabricksProven ability to lead technically and mentor engineersWhat you’ll getWe believe in rewarding our people properly:Up to 10.5% annual bonusOutstanding pension – up to 21% combined contributionPrivate healthcareShare buy schemeWellbeing benefits and support programmesOtherWhy United Utilities?You’ll be working on data that truly matters — protecting rivers, supporting environmental compliance, and helping shape the future of sustainable water management across the North West.If you’re passionate about modern data engineering, enjoy technical leadership, and want your work to have real-world environmental impact, we’d love to hear from you.
Lead Data Engineer (Databricks) in Olney employer: United Utilities
United Utilities is an exceptional employer, offering a dynamic work environment where commercial professionals can thrive while contributing to vital infrastructure projects that benefit communities across the North West. With competitive salaries, flexible working arrangements, and robust career development opportunities, we empower our employees to grow and make a meaningful impact in their roles. Join us to be part of a purpose-driven organisation that values innovation and collaboration.
