The Role: Technical Lead - Multi-tenant Data Integration Platform - GCP
Location: Sheffield, UK
Position Type: Contract Inside IR35
Remote work option Available: 2-3 Days Onsite in a week
Job Description
Required experience & skills
- Proven experience as a Technical Lead / Lead Engineer delivering data engineering or integration platforms in cloud environments.
- Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Apache Airflow.
- Solid experience on Google Cloud Platform, such as:
- Data services (e.g., BigQuery, Cloud Storage, Pub/Sub, Dataflow) and/or container platforms (e.g., GKE, Cloud Run)
- IAM, networking, secrets management, and environment separation
- Strong software engineering foundations: Python, APIs, configuration management, testing strategy, and performance tuning.
- CI/CD expertise (pipeline tooling, release controls, automated quality gates) and Infrastructure-as-Code experience (e.g., Terraform).
- Experience designing for reliability retries, idempotency, dead-letter patterns, backpressure handling, and operational resilience.
- Ability to translate complex technical topics for mixed audiences and drive alignment across teams.
Desirable
- Experience implementing or integrating data lineage/metadata management tooling (e.g., Data Catalog-style metadata, OpenLineage, DataHub, etc.).
- Experience with multi-tenant platforms (tenant isolation models, metadata-driven frameworks).
- Knowledge of data governance concepts (data quality, auditability, retention, access controls).
- Experience integrating with external vendor systems and managing vendor technical dependencies
#J-18808-Ljbffr
Technical Lead - Multi-Tenant Data Integration Platform - GCP in Barnsley employer: Vallum Associates
As an Electronics Test Engineer at our company, you will be part of a dynamic and innovative team dedicated to pushing the boundaries of technology in a collaborative work environment. We offer competitive benefits, a strong focus on employee development, and opportunities for career advancement, all while being located in a vibrant area that fosters creativity and growth. Join us to make a meaningful impact in the field of electronics testing and enjoy a rewarding career with us.
