More About The Role
DevOps Data Engineer Location: Bradford Head Office Department: Data Analytics and Science Employment Type: Full-time
Role Overview Do you want to help us advance our Data Strategy at Morrisons? We are seeking a Mid- Level DevOps Data Engineer to manage our modern Google Cloud Platform (GCP) data environment, and support us in progressing our DevOps practices that will enshrine our Data as a Product policies as code . This role is evenly split between infrastructure automation and data pipeline development. You will write clean pipeline code to ingest data into BigQuery, while using Terraform to provision and scale our infrastructure. Your work will directly impact the speed, reliability, and security of data delivered to Looker and AI tooling for business intelligence. You will work closely with our Senior Data Ops leader, developing our Data Ops practices and driving adoption with our Data Engineering delivery partner.
- On-site Expectancy: 3 days per week at our head office.
Key Responsibilities
Infrastructure Automation & IaC (50%)
- Provision GCP Infrastructure: Write and maintain Terraform scripts to provision BigQuery datasets, Cloud Storage buckets, IAM roles, and compute resources.
- Maintain Platform Security: Implement fine-grained access control, column-level security in BigQuery, and secure service accounts using Terraform.
- Optimise Costs & Resources: Monitor GCP resource utilization and implement automation to optimise BigQuery compute (slots) and storage costs.
- Build Ingestion Pipelines: Code automated ETL/ELT pipelines to extract, transform, and load diverse data sources into BigQuery.
- Automate CI/CD: Design and manage deployment workflows using Jenkins to automate data pipeline testing and infrastructure updates.
- Support BI Delivery: Collaborate with Data Analysts to optimise BigQuery schemas and performance, ensuring fast query execution for Looker dashboards.
- Monitoring & Alerting: Set up Cloud Monitoring and Logging to track Jenkins job statuses and BigQuery pipeline health.
About You
- Proven experience managing production environments specifically inside Google Cloud Platform (GCP).
- Infrastructure as Code: Strong proficiency with Terraform for GCP infrastructure management.
- CI/CD & Coding: Hands-on experience building and maintaining automation pipelines in Jenkins.
- Languages: High proficiency in SQL (BigQuery dialect) and Python. Some experience with Java will be a plus.
- BI Integration: Basic familiarity with Looker development (LookML) or supporting Looker data models is highly desirable.
- Ability to collaborate and influence Onshore and Offshore supplier engineering build teams
#J-18808-Ljbffr
DevOps Data Engineer - Wm Morrisons Supermarkets in Bradford employer: OpenTalent
At TwinStream, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters collaboration and innovation. Our hybrid working model in Cheltenham allows for flexibility while providing ample opportunities for professional growth and development within the tech sector. With a focus on meaningful projects that support government organisations, employees can find purpose in their work while enjoying competitive benefits and a supportive team environment.
