The Role
We are seeking an experienced GCP Data Engineer to design, build, and optimize scalable cloud-native data platforms on Google Cloud Platform (GCP). The ideal candidate will have strong expertise in developing batch and real-time data pipelines, implementing data lake and data warehouse solutions, and enabling data-driven analytics and AI/ML initiatives. The role involves close collaboration with architects, data scientists, business analysts, and application teams to deliver high-quality, secure, and reliable data solutions
Your responsibilities:
β’ Build batch and streaming data ingestion frameworks using Dataflow, Dataproc, Pub/Sub, and Cloud Functions.
β’ Develop reusable and optimized data processing solutions using PySpark and Python.
β’ Implement orchestration workflows using Cloud Composer (Apache Airflow).
β’ Ensure data quality, integrity, lineage, and governance across data platforms.
β’ Implement partitioning, clustering, and performance tuning strategies in BigQuery.
β’ Manage structured, semi-structured, and unstructured data processing requirements.
β’ Implement IAM policies, data security controls, and compliance requirements.
β’ Participate in technical design discussions, code reviews, and solution governance meetings.
Your Profile
Essential skills/knowledge/experience:
β’ Google Cloud Platform (GCP)
β’ BigQuery
β’ Dataproc
β’ Cloud Composer (Airflow)
β’ Pub/Sub
β’ Dataflow
β’ Cloud Storage
β’ Python
β’ PySpark
β’ SQL
β’ Terraform
β’ Git, CI/CD
Desirable skills/knowledge/experience:
β’ Strong analytical and problem-solving skills.
β’ Excellent communication and stakeholder management capabilities.
β’ Ability to work in global and multi-vendor environments.
β’ Experience delivering solutions for data modernization and cloud migration initiatives.
GCP Data Engineer in London employer: Tcs Uk
As a Provisioning Engineer at our company, you will thrive in a dynamic work culture that prioritises innovation and collaboration. We offer competitive benefits, including professional development opportunities and a supportive environment that encourages growth in the rapidly evolving telecom sector. Located in a vibrant area, our team enjoys a balance of work and life, making it an excellent place for those seeking meaningful and rewarding employment.