At a Glance
- Tasks: Design and optimise automated data pipelines for Google Cloud Platform and BigQuery.
- Company: Join a forward-thinking tech company in Halifax or Leeds with a hybrid work model.
- Benefits: Enjoy competitive pay, flexible working, and opportunities for professional growth.
- Other info: Dynamic role with excellent career advancement potential in a collaborative environment.
- Why this job: Make a real impact by leading innovative data ingestion projects in the cloud.
- Qualifications: Experience in cloud engineering and data integration, especially with GCP and BigQuery.
The predicted salary is between 60000 - 80000 £ per year.
We are seeking an experienced Cloud Data Loading Architect to design, build, and optimise automated pipelines that ingest structured, semistructured, and unstructured datasets into Google Cloud Platform (GCP), specifically BigQuery.
This role will lead end-to-end data ingestion design—from source discovery and schema mapping, through transformation and data quality, to scalable, secure loads into cloud-native analytical warehouses. The ideal candidate combines strong cloud engineering skills with hands-on data integration experience and a deep understanding of BigQuery performance optimisation.
Key Responsibilities
- Design and implement high-throughput, fault-tolerant ingestion pipelines for batch and streaming data landing in BigQuery.
- Lead data ingestion architecture patterns using Cloud Storage (GCS), Dataflow, Dataproc, Composer (Airflow), Pub/Sub, BigQuery Storage Write API, and related services.
- Define data loading frameworks, mapping rules, schema evolution strategy, and metadata management.
- Create reusable ingestion blueprints that ensure governance, lineage, and auditability.
- Establish data quality checks, validation rules, reconciliation logic, and SLAs.
- Optimise BigQuery cost, storage, partitioning, clustering, and access patterns.
- Collaborate with security & platform teams to ensure IAM, service accounts, VPCSC, and encryption policies are fully applied.
- Automate CI/CD deployments for ingestion pipelines using Cloud Build, GitHub, GitLab or Jenkins.
- Produce detailed technical documentation and coach engineering squads in cloud ingestion standards.
- Troubleshoot ingestion failures, performance bottlenecks, and cross-platform data integration issues.
Top 10 Skillset & Qualities (Ideal Candidate)
- Deep Expertise in Google Cloud Data Services: BigQuery, GCS, Dataflow (Apache Beam), Pub/Sub, Dataproc, Cloud Composer, Storage Write API.
- Data Ingestion Engineering Mastery: Hands-on experience designing frameworks to load data from APIs, files, databases, event streams, and mainframe/legacy systems into cloud stores.
- Strong SQL & BigQuery Optimisation Skills: Partitioning, clustering, materialised views, cost-efficient query design, columnar storage understanding.
- ETL/ELT Architecture Knowledge: Experience building transformation pipelines using Airflow, Dataflow, dbt, or equivalent orchestration tools.
- File & Format Proficiency: Ability to work with Parquet, Avro, ORC, JSON, CSV, nested/repeated structures, and schema evolution.
- Strong Python and/or Java Skills: Used to build Dataflow pipelines, ingestion utilities, automation scripts.
- Cloud Security & Governance Awareness: IAM roles, least-privilege models, VPCSC, service accounts, artifact signing, audit logging.
- DevOps & CI/CD Familiarity: Cloud Build, GitHub Actions, Terraform, Cloud Deployment Manager or Pulumi.
- Data Quality & Observability Mindset: Experience implementing validation frameworks, anomaly detection, reconciliation rules, logging/monitoring (e.g., Cloud Logging, Cloud Monitoring).
- Excellent Architectural Communication Skills: Ability to document, diagram, and communicate ingestion patterns to stakeholders at technical and non-technical levels.
Cloud Data Loading Architect (GCP and BigQuery) in Leeds employer: Insight International (UK) Ltd
As a leading employer in the financial services sector, we offer the Chaos Engineering Tech Lead an opportunity to drive innovation and resilience within our Treasury Technology team. Our collaborative work culture fosters continuous learning and professional growth, supported by comprehensive training programs and mentorship from industry experts. Located in a vibrant city, we provide a dynamic environment where your contributions directly impact critical services, ensuring both personal fulfilment and career advancement.
Contact Details:
Insight International (UK) Ltd Recruitment Team
StudySmarter Expert Advice🤫
We think this is how you could land Cloud Data Loading Architect (GCP and BigQuery) in Leeds
✨Tip Number 1
Network like a pro! Reach out to folks in the industry on LinkedIn or at local meetups. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving GCP and BigQuery. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common questions related to cloud data architecture. Practice explaining your past projects and how you tackled challenges—this will help you shine during the interview.
✨Tip Number 4
Don't forget to apply through our website! We love seeing candidates who are genuinely interested in joining us. Plus, it makes tracking your application a breeze!
We think you need these skills to ace Cloud Data Loading Architect (GCP and BigQuery) in Leeds
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Cloud Data Loading Architect role. Highlight your experience with GCP, BigQuery, and data ingestion frameworks. We want to see how your skills match what we're looking for!
Showcase Your Projects:Include specific projects where you've designed or optimised data pipelines. We love seeing real-world examples of your work, especially if they involve the tools mentioned in the job description like Dataflow or Pub/Sub.
Be Clear and Concise:When writing your application, keep it clear and to the point. Use bullet points for your achievements and responsibilities to make it easy for us to read. We appreciate a well-structured application!
Apply Through Our Website:Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to see what you bring to the table!
How to prepare for a job interview at Insight International (UK) Ltd
✨Know Your GCP Inside Out
Make sure you brush up on your knowledge of Google Cloud Platform, especially BigQuery and its related services. Be ready to discuss how you've used these tools in past projects, focusing on specific examples of data ingestion and optimisation.
✨Showcase Your Data Ingestion Mastery
Prepare to talk about your hands-on experience with designing and implementing data ingestion frameworks. Highlight any challenges you've faced and how you overcame them, particularly with batch and streaming data loads.
✨Demonstrate Your SQL Skills
Since strong SQL and BigQuery optimisation skills are crucial for this role, be ready to solve some SQL problems during the interview. Practice writing queries that involve partitioning, clustering, and cost-efficient designs to impress your interviewers.
✨Communicate Clearly and Effectively
Your ability to document and communicate architectural patterns is key. Prepare to explain complex concepts in simple terms, as you'll need to convey your ideas to both technical and non-technical stakeholders. Practise explaining your past projects succinctly.
