Lead AWS Data Engineer

Lead Data Engineer ( Databricks ) London – Hybrid – Remote
Permanent
£100,000 – £130,000 plus up to 20% bonus based on performance and commercial contribution

We’re looking for a Lead Data Engineer to spearhead some of our clients most strategic Databricks engagements.

You\’ll be leading high-performing squads, guiding complex transformations, and working directly with senior stakeholders to bridge business needs and engineering excellence — particularly in industries like manufacturing, utilities, and aviation.

Act as the technical lead on client engagements, owning design and delivery of data solutions in Databricks.
Architect robust, scalable data platforms using the medallion architecture.
Translate business requirements into scalable workflows, advising on data governance, quality, and security.
Design and implement complex data pipelines using tools like Delta Live Tables (DLT) and Unity Catalog.
Guide teams in implementing best practices across engineering, DevOps, and model deployment.
Collaborate closely with Platform Engineers and Platform Architects to align infrastructure with data needs.
Lead a team of data engineers, fostering a collaborative and growth-oriented environment.
Evaluate new data engineering technologies and strategies, assessing their relevance and fit for the organisation’s strategic goals.
Work closely with the commercial team to scope projects and develop proposals that align technical capabilities with client requirements.

8+ years in data engineering, with at least 2+ in a technical leadership role
~ Proven experience designing and leading Databricks-based data platforms
~ Deep understanding of the medallion architecture , data lakehouse design, and transformation workflows
~ Hands-on expertise with DLT , Unity Catalog , and model deployment frameworks
~ Experience in agile delivery environments and cross-functional teams
~ Commercial awareness – comfortable contributing to pre-sales, growing accounts, and engaging with commercial targets

Experience in physical asset-heavy industries (e.g. utilities, manufacturing, aviation)
Familiarity with platform and DevOps collaboration , especially on AWS or Azure
Certifications in Databricks or cloud platforms (AWS/Azure)
Be the go-to technical leader on projects with real-world business impact
Career progression into Delivery Lead , Practice Lead , or Pre-Sales Specialist
Competitive compensation and strong bonus structure, aligned with delivery and commercial impact

To find out more about this high profile Lead Data Engineering position, click apply.