Location: York or London β predominantly remote, with office attendance up to 3β4 times per month.
We're recruiting an experienced Lead Data Engineer to support a major finance transformation programme for a global organisation in the insurance sector.
The programme involves building a Unified Data Platform on Google Cloud Platform (GCP), replacing legacy data processes with scalable, reusable ingestion capabilities across multiple business units and source systems.
This is a hands-on technical leadership contract. We need somebody who has already designed and delivered enterprise-scale data ingestion solutions on GCP and can establish the engineering approach from day one.
What you'll be doing
- Own the technical direction for data acquisition, ingestion and source-system onboarding.
- Design and implement scalable, reusable, metadata-driven ingestion frameworks.
- Establish data engineering standards, architectural patterns and technical guardrails.
- Lead the design of batch and incremental ingestion pipelines across multiple enterprise source systems.
- Provide technical oversight, challenge design decisions and guide engineers through delivery.
- Ensure ingestion solutions are reliable, maintainable, secure and scalable.
Essential experience β all required
- Proven experience designing reusable, metadata-driven or configuration-driven ingestion frameworks, not simply developing individual pipelines.
- Previous Lead or Principal Data Engineer experience, with ownership of technical architecture and engineering standards.
- Strong experience with Python, SQL and enterprise ETL/ELT development.
- Experience integrating multiple source systems into cloud data platforms.
- Proven ability to establish reusable engineering patterns, code quality standards and production-ready delivery practices.
- Ability to work independently, make technical decisions and deliver immediately.
Experience within financial services, insurance or similarly regulated enterprise environments would be advantageous.
This is not a step-up opportunity. We're looking for an established GCP Data Engineering Lead who has already delivered comparable solutions and can demonstrate exactly how they've done it.
If you've delivered enterprise GCP ingestion platforms and reusable frameworks, get in touch.
Data Team Lead in York employer: Corecom Consulting
Join a forward-thinking company that prioritises innovation and employee growth, offering a dynamic remote work environment for Senior Product Engineers. With a strong focus on modernising applications and developing cutting-edge AI products, you'll enjoy the autonomy to lead projects while collaborating with a passionate team. The culture fosters continuous learning and mentorship, making it an ideal place for engineers eager to expand their skills in a rapidly evolving field.