Location: Leeds - Hybrid (2-3 days onsite per week)
Contract: 12 months
IR35 Status: Inside IR35
Day Rate: Competitive - dependent on experience
Start Date: December 2026 (ASAP)
Security Clearance: SC Cleared or SC Eligible
The Opportunity
We're recruiting an experienced Senior Data Engineer to support a major AI and digital transformation programme within a highly regulated UK organisation.
This is an exciting opportunity to contribute to a significant technology modernisation initiative, helping develop and enhance the data infrastructure underpinning the organisation's evolving AI capabilities.
You'll be working extensively across Microsoft Fabric, Azure and Databricks, building scalable data solutions, modernising existing platforms and supporting the delivery of enterprise data services.
The successful candidate will be a technically strong, hands-on Data Engineer with demonstrable experience delivering production-grade data solutions.
Key Responsibilities
- Design, develop and maintain enterprise data solutions within Microsoft Fabric, including Lakehouse, Warehouse and OneLake.
- Develop and optimise data ingestion, transformation and orchestration processes using Fabric Data Pipelines and Dataflow Gen2.
- Build and maintain data processing solutions using PySpark, Spark SQL and T-SQL.
- Support the modernisation and migration of existing Azure Synapse and Azure Data Factory workloads.
- Develop, maintain and enhance ETL/ELT pipelines across Azure and Microsoft Fabric.
- Support CI/CD implementation, deployment automation and release management for Fabric workloads.
- Troubleshoot, optimise and maintain data platform performance, reliability and operational efficiency.
- Support existing business-critical data products, including document extraction and large-scale data processing solutions.
- Collaborate with AI, engineering, architecture and business stakeholders to deliver integrated data capabilities.
- Proven commercial experience as a Senior Data Engineer delivering complex enterprise data solutions.
- Hands-on Microsoft Fabric experience, including Lakehouse, Warehouse and OneLake.
- Experience developing data pipelines using Microsoft Fabric Data Pipelines and Dataflow Gen2.
- Strong programming and data transformation skills using PySpark, Spark SQL and T-SQL.
- Strong experience with Microsoft Azure data technologies, particularly Azure Data Factory and Synapse Analytics.
- Experience designing, building and optimising enterprise ETL/ELT pipelines.
- Understanding of CI/CD processes, data platform deployments and production support.
- Ability to work collaboratively with technical and non-technical stakeholders.
- Active UK SC clearance or eligibility to undergo Security Check clearance.
- Availability to work onsite in Leeds 2-3 days per week.
- Experience migrating data platforms from Azure Synapse or ADF into Microsoft Fabric.
- Experience supporting data infrastructure for AI or machine learning applications.
- Previous experience within public-sector, healthcare, life sciences or other highly regulated environments.
- Experience supporting large-scale document extraction and data processing pipelines.
Why Consider This Opportunity?
You’ll be joining a major AI transformation initiative, working with modern Microsoft technologies to build and enhance the data infrastructure supporting critical business operations.
The programme offers a technically challenging environment, the opportunity to influence enterprise data architecture and a long-term contract supporting meaningful digital transformation.
Shortlisting is taking place immediately, with interviews being prioritised.
Senior Data Engineer in Leeds employer: TechNET
As a leading global technology consultancy, we pride ourselves on fostering a dynamic work culture that encourages innovation and collaboration. Our London/Middlesex location offers a hybrid working model, allowing for flexibility while engaging directly with clients to drive impactful AI transformations. We are committed to employee growth, providing opportunities for professional development and hands-on experience in cutting-edge AI technologies, making us an exceptional employer for those seeking meaningful and rewarding careers.