Data Engineering Lead

Data Engineering Lead

Full-Time 80000 - 100000 £ / year (est.) No working from home possible
ECS Resource Group

At a Glance

  • Tasks: Lead a team to design and implement a modern data platform using Microsoft Fabric.
  • Company: Join one of the UK's top tech and cloud services providers.
  • Benefits: Competitive salary, career development, and a dynamic work environment.
  • Other info: Opportunity to mentor a high-performing team and drive innovation.
  • Why this job: Make a real impact by shaping data architecture for strategic decision-making.
  • Qualifications: Experience in data engineering, leadership skills, and proficiency in Python and SQL.

The predicted salary is between 80000 - 100000 £ per year.

We are recruiting for an experienced Data Engineering Lead, working for one of the UK’s leading technology and cloud services providers, as they continue to invest in a modern, scalable Microsoft Fabric data platform. This role owns the end‑to‑end data engineering architecture — from ingestion and lakehouse design to enabling trusted, self‑service analytics across the organisation. You will lead a small engineering team, define technical standards, and work closely with senior stakeholders to ensure data underpins strategic and operational decision‑making.

Role Purpose

To take ownership of the organisation’s data platform architecture and delivery, ensuring reliable, scalable ingestion pipelines, a well‑designed data warehouse, and high‑quality analytics products. The role combines hands‑on technical leadership with people management and cross‑business collaboration.

Key Responsibilities

  • Own the data warehouse schema, lakehouse design, and core data models
  • Translate business requirements into pragmatic, scalable data architecture decisions
  • Define, implement, and maintain data contracts aligned to business domains
  • Establish data quality, observability, and SLA frameworks
  • Design and evolve scalable data pipelines (batch and incremental watermark‑based ingestion) using:
    • Microsoft Fabric Pipelines
    • PySpark / Python Fabric Notebooks
  • Implement and maintain a medallion lakehouse architecture using OneLake and Fabric Warehouses
  • Ensure Direct Lake–ready semantic models for analytics
  • Lead incident management, root cause analysis, and data issue post‑mortems

Analytics Enablement

  • Enable self‑service analytics through governed Power BI datasets
  • Support and guide the production of trusted Power BI reporting using data contracts

Leadership & Ways of Working

  • Define engineering standards and review pull requests
  • Mentor and develop 2–4 data and cloud engineers
  • Drive the data and warehouse roadmap alongside the Digital Transformation Director
  • Champion CI/CD, secure secret management, and software engineering best practices

Role Objective

  • Deliver and continuously refine a Microsoft Fabric data warehouse supporting business‑led decision making
  • Integrate data from diverse sources including APIs, files, databases, and cloud platforms
  • Establish data contracts as a core mechanism for trusted analytics
  • Scale Power BI reporting using standardised, high‑quality data products
  • Provide clear, motivating leadership to direct reports
  • Conduct regular 1:1s, performance reviews, and development planning
  • Recruit, onboard, and develop a high‑performing data engineering team
  • Ensure compliance with company policies, legal obligations, and operating procedures

Experience & Technical Skills

  • Experience leading or mentoring data engineers
  • Hands‑on experience with Microsoft Fabric, including: Workspaces, OneLake, Fabric Warehouses, Fabric Notebooks and Data Pipelines and Direct Lake semantic models
  • Strong Python and PySpark development capability
  • Solid SQL skills for warehouse development and metadata layers
  • CI/CD pipelines within Azure and Fabric
  • Azure Key Vault or similar secret management
  • Experience in telecoms or cloud‑focused environments
  • Strong understanding of dimensional modelling and medallion architecture
  • Experience integrating REST APIs, SFTP, and cloud‑based data sources
  • Ability to communicate technical trade‑offs to non‑technical stakeholders
  • Excellent troubleshooting, prioritisation, and delivery focus

Data Engineering Lead employer: ECS Resource Group

As a leading technology and cloud services provider in the UK, we pride ourselves on fostering a dynamic work culture that encourages innovation and collaboration. Our commitment to employee growth is evident through tailored development programmes and mentorship opportunities, ensuring that our team members thrive in their careers. With a focus on cutting-edge technology and a supportive environment, we offer a unique chance to lead impactful projects while enjoying the benefits of a modern workplace.

ECS Resource Group

Contact Details:

ECS Resource Group Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Data Engineering Lead

Tip Number 1

Network like a pro! Reach out to your connections in the tech and cloud services space. Attend meetups, webinars, or even local events. You never know who might have the inside scoop on job openings or can refer you directly.

Tip Number 2

Show off your skills! Create a portfolio showcasing your data engineering projects, especially those involving Microsoft Fabric. This will give potential employers a taste of what you can do and set you apart from the crowd.

Tip Number 3

Prepare for interviews by brushing up on your technical knowledge and soft skills. Be ready to discuss your experience with data pipelines, lakehouse architecture, and how you've led teams in the past. Practice makes perfect!

Tip Number 4

Don’t forget to apply through our website! We’re always on the lookout for talented individuals like you. Plus, it’s a great way to ensure your application gets the attention it deserves.

We think you need these skills to ace Data Engineering Lead

Data Engineering Architecture
Microsoft Fabric
Lakehouse Design
Data Warehouse Development
Data Pipeline Design
PySpark
Python

Some tips for your application 🫡

Tailor Your CV:Make sure your CV reflects the skills and experiences that match the Data Engineering Lead role. Highlight your hands-on experience with Microsoft Fabric, Python, and data architecture to grab our attention!

Craft a Compelling Cover Letter:Use your cover letter to tell us why you're the perfect fit for this role. Share specific examples of how you've led teams or managed data projects in the past, and don’t forget to show your passion for data engineering!

Showcase Your Technical Skills:In your application, be sure to mention your technical expertise, especially with CI/CD pipelines and Azure. We love seeing candidates who can communicate complex concepts clearly, so don’t shy away from sharing your experiences!

Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team!

How to prepare for a job interview at ECS Resource Group

Know Your Tech Inside Out

Make sure you’re well-versed in Microsoft Fabric, PySpark, and Python. Brush up on your SQL skills too! Be ready to discuss how you've used these technologies in past projects, especially in relation to data architecture and pipeline design.

Showcase Your Leadership Skills

As a Data Engineering Lead, you'll need to demonstrate your ability to mentor and guide a team. Prepare examples of how you've successfully led teams, managed performance reviews, and fostered a collaborative environment. Highlight any experience you have with defining engineering standards.

Understand the Business Side

This role requires translating business requirements into technical solutions. Familiarise yourself with the company’s goals and think about how data can drive decision-making. Be prepared to discuss how you’ve aligned data strategies with business objectives in previous roles.

Prepare for Scenario Questions

Expect questions that assess your problem-solving skills, especially around incident management and root cause analysis. Think of specific challenges you've faced in data engineering and how you resolved them. This will show your analytical thinking and delivery focus.