Lead Data Engineer in Romford

Lead Data Engineer in Romford

Romford Full-Time 56058 - 60393 £ / year (est.) On-site
L

At a Glance

  • Tasks: Lead the development and modernisation of Havering's data estate using Microsoft Fabric.
  • Company: Join the London Borough of Havering, a forward-thinking council focused on data innovation.
  • Benefits: Competitive salary, career growth opportunities, and a chance to impact public services.
  • Other info: Collaborative environment with a focus on modern tech and meaningful contributions.
  • Why this job: Shape the future of data management while supporting essential community services.
  • Qualifications: Experience in SQL Server, data engineering, and cloud technologies required.

The predicted salary is between 56058 - 60393 £ per year.

Help shape Havering's modern, connected and secure data estate. The London Borough of Havering is modernising how we manage, connect and use data across our services, with Microsoft Fabric at the heart of our future data and analytics architecture. We're looking for an experienced, hands-on Lead Data Engineer to help develop and mature our Microsoft data environment, drive the phased migration and consolidation of legacy data platforms, and embed modern engineering and governance practices.

Our existing corporate data warehouse brings together information from more than 30 council and supplier systems, supporting essential services including housing, social care, education, council tax, benefits, electoral registration and parking. This data underpins day-to-day operations, statutory reporting, fraud prevention and emergency response. Our ambition is to create a more integrated, scalable and well-governed data estate, reducing complexity, improving data quality and accessibility, and enabling better use of information across the Council. This is an opportunity to contribute to meaningful data modernisation, combining hands-on engineering with the chance to influence how Havering's data capabilities develop over the coming years.

About the role: Working within our Digital function, you'll take a leading, hands-on role in developing and modernising Havering's data estate, with Microsoft Fabric as our strategic data and analytics platform. You'll work closely with data engineers, analysts, architects, software developers, service teams and external partners to deliver reliable solutions, improve engineering practices and support the transition from legacy technologies. You'll take ownership of technical deliverables, contribute to solution design and engineering decisions, and help ensure our data services remain reliable, secure and maintainable as the environment evolves.

Your key areas of focus will include:

  • Microsoft Fabric and data engineering: Developing, optimising and maintaining our Microsoft Fabric environment, including OneLake, Data Factory pipelines, lakehouses, warehouses, Spark notebooks, Delta tables and Power BI semantic models.
  • Legacy migration and modernisation: Assessing and prioritising existing SQL Server data warehouses, SSIS packages, data marts and integrations; designing appropriate migration and modernisation approaches; and delivering phased improvements with robust testing, data validation and service continuity.
  • Data estate structure and engineering standards: Helping develop consistent approaches to workspace organisation, development, test and production environments, access management, source control, automated deployment, monitoring and operational management.
  • Data warehouse and integration: Developing, maintaining and improving SQL Server data warehouses and ETL/ELT processes, integrating data from cloud and on-premises databases, Dynamics 365, Dataverse, APIs, SFTP and other business systems.
  • SQL development and optimisation: Writing and tuning complex T-SQL, stored procedures and views, improving performance and investigating data issues through root-cause analysis.
  • Master data and existing applications: Supporting person-matching services, golden-record management, UPRN-based address matching and the Local Land and Property Gazetteer, alongside existing ASP.NET/C# applications and opportunities for modernisation.
  • Data governance and security: Embedding data quality, ownership, metadata management, lineage and appropriate access controls into engineering solutions. Working with Information Governance and Data Protection colleagues to protect sensitive information, support DPIAs and meet UK GDPR requirements, while developing the use of Microsoft Fabric and Purview governance capabilities.
  • Platform performance and reliability: Monitoring and optimising data pipelines, workloads and platform performance, supporting capacity and cost efficiency, troubleshooting production issues and implementing reliable operational processes.
  • DevOps and automation: Improving engineering practices through Git, Azure DevOps, CI/CD, automated testing and Microsoft Fabric deployment pipelines.
  • Technical leadership and collaboration: Taking ownership of engineering deliverables, contributing to technical decisions, mentoring colleagues, reviewing technical work and promoting consistent, maintainable engineering practices across the data estate.
  • Future digital capabilities: Establishing trusted, reusable data foundations for analytics, Power BI, Power Platform, joined-up digital services, automation and responsible AI adoption.

About you: We're looking for a skilled and proactive data engineer who enjoys solving complex problems, takes ownership of technical delivery and is motivated by the opportunity to modernise a significant data environment. You'll bring:

  • Strong experience developing and supporting SQL Server data warehouses, data marts and ETL/ELT processes in production environments.
  • Advanced T-SQL skills, including query optimisation, stored procedures and troubleshooting.
  • Experience building and maintaining reliable data pipelines, including SSIS or comparable integration technologies.
  • Experience with Microsoft Fabric, Azure Data Factory, Databricks or another modern cloud data engineering platform.
  • Experience modernising or migrating legacy data solutions to cloud-based environments.
  • Good knowledge of data modelling, integration patterns, data quality and performance optimisation.
  • Experience integrating data from databases, business applications, APIs and file-based sources.
  • Familiarity with Git, Azure DevOps or equivalent source control and deployment practices.
  • An understanding of data governance, information security and UK GDPR, including handling sensitive information.
  • Strong problem-solving and communication skills, with the ability to work collaboratively across technical and service teams.

Experience in the following areas would be advantageous:

  • Hands-on Microsoft Fabric experience, including lakehouses, warehouses, PySpark, Spark SQL and Delta Lake.
  • Microsoft Purview and data governance tooling.
  • Dynamics 365, Dataverse, Power Apps or Power Automate.
  • ASP.NET/C# applications connected to SQL Server.
  • Master data management, person matching, UPRN and address data management.
  • Python, PowerShell or Azure Logic Apps.
  • Local government or other public sector data environments.
  • Relevant Microsoft certifications, such as DP-600 or DP-700.

We don't expect you to be an expert in every technology listed. What matters most is strong data engineering expertise, sound technical judgement, a commitment to delivering reliable solutions and a willingness to embrace new technologies as our data estate evolves.

Why join us? You'll have the opportunity to help shape Havering's future data estate, working with modern Microsoft technologies while contributing to the migration and modernisation of existing systems. Your work will support essential public services, improve how information is shared and used, and help establish the foundations for better analytics, digital services and responsible AI adoption. You'll be part of a collaborative Digital function, working alongside engineers, architects, analysts and service teams, with opportunities to develop your skills, influence technical decisions and deliver meaningful improvements. If you enjoy solving complex data challenges, working with modern technologies and making a practical difference through better use of data, we'd welcome your application.

Please view Job Profile here. For an informal discussion about the post, please contact. The closing date for applications is 24 December 2026. We reserve the right to close the vacancy early if there is significant interest. Successful applicants will be contacted with details of the next stage of the recruitment process.

Additional Information: We want everyone to choose Havering. When you apply for a job with us, your application is considered on its merits regardless of your age, disability, ethnicity, faith, gender identity or sexual orientation. Our residents and service users come from all walks of life, and so do our employees. Find out what it means to Choose Havering. The London Borough of Havering has important responsibilities for safeguarding and promoting the welfare of children, young people and vulnerable adults. If you are appointed to a job that involves working with these groups, you may be subject to a Disclosure and Barring Service (DBS) check. Please attach your supporting statement, explaining in no more than two A4 sides why and how you meet the criteria for this role. We practise anonymised recruitment. Please ensure that you remove all personal information from any documents that you upload.

With its excellent transport links into central London, extensive town centre regeneration and the highest concentration of green space anywhere in London, Havering has a unique offer as a place to live, work and visit. By making the most of its position and opportunities, Havering is becoming a hub for start-ups and expanding businesses, as well as construction, logistics, engineering and manufacturing industries. Find out why you should work for Havering Council.

Lead Data Engineer in Romford employer: London Borough of Havering

Havering SEND and Alternative Provision Service is an exceptional employer, offering a dynamic work environment where passionate professionals collaborate to improve outcomes for children and families. With a strong commitment to employee development, flexible working options, and access to state-of-the-art resources, you will thrive in a supportive multidisciplinary team dedicated to making a meaningful impact in the community. Join us in shaping the future of early years support in Havering, where your expertise will be valued and your contributions will drive transformational change.

L

Contact Details:

London Borough of Havering Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Lead Data Engineer in Romford

✨Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like London Borough of Havering!

✨Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Lead Data Engineer at London Borough of Havering.

✨Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like London Borough of Havering.

✨Apply Directly through Our Website

When you find a suitable opening like Lead Data Engineer at London Borough of Havering, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Lead Data Engineer in Romford

Communication Skills
Problem-Solving Skills
Python
SQL
Data Engineering
ETL/ELT Processes
Data Pipeline Development

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at London Borough of Havering, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at London Borough of Havering. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at London Borough of Havering

✨Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

✨Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

✨Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at London Borough of Havering!

✨Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.