IT Data Engineer

Scope & Key Interfaces Deliver the data engineering roadmap for ‘Group Data’ ensuring delivery of demonstratable real value to Greene King Own the end-to-end data engineering lifecycle from data ingestion to data transformation to data serving for new data sources Support and input to the development and optimisation of data engineering tools / processes / environments Own the ongoing maintenance and optimisation of existing data pipelines Own the documentation of all existing and new data pipelines and processes Manage the testing of all deployed solutions to ensure all solutions are accurate and fault tolerant Ensure adherence to all regulation so that data engineering solutions and resulting business usage is compliant Act as a technical data steward to review and optimise the data quality across the central data platform Collaborate with the data architect(s) to deliver data solutions in line with overall strategy and principles Collaborate with the digital analytics team to understand the business requirements and needs to ensure data engineer solutions deliver the optimal business return Collaborate with the Business Intelligence and ETL teams to ensure alignment with data management and transformation logic while also avoiding duplication of effort / work Work with cross-functional teams including Retail IT, Operations and Business Units to understand requirements and data/system challenges Collaborate with the Business to understand the business challenges and opportunities and optimise the value that can delivered from Greene King’s data Understand and map data flows across the business and systems to identify opportunities to drive value Maintain and support up-to-date records of all system integrations, data flows, process maps, system diagrams, business rules and data models related to the data pipelines Collaborate with the data architect(s) and Cloud Engineering team to accurately estimate cloud service requirements and costs Proactively research latest developments and emerging trends in data engineering, AI and data science which apply to our industry Company Description The IT Data Engineer will act as a pivotal role in furthering the data maturity of the Data & AI department through delivering the data engineering roadmap. The IT Data Engineer will provide specialised support to the team acting as an expert and consultant to deliver solutions which enable the business to deliver optimal value. The IT Data Engineer will be accountable for the end-to-end engineering lifecycle from ingestion to transformation to serving. The IT Data Engineer will support with the development and optimisation of the environment and platforms to ensure continued growth and delivery of industry best practice. The IT Data Engineer will create and deliver appropriate documentation and training on processes and solutions to increase data maturity across Greene King. Additional Information We’re all about rewarding our team’s hard work, that’s why… You’ll receive a competitive salary, pension contribution as well as: The chance to further your career across our well-known brands – as one of the industry\'s top apprenticeship providers, we can provide training and development at each level of your career. Discount of 33% for you and 15% for your loved ones on all of our brands – so you enjoy your favourite food and drink at a discount. Free employee assistance program – mental health, well-being, financial, and legal support because you matter! Discount of 50% for you and 25% for your loved ones at our Greene King Inns and hotels. – so you can enjoy a weekend away without breaking the bank. Refer a friend – who do you know who could be interested in a new role? When they are placed, you could receive £1,500 for referring them! Wagestream – access your wage before payday for when life happens. Retail discounts – Receive up to 30% off at Superdrug, exclusive discounts with three mobile along with many more… Qualifications Degree level qualification in a relevant subject e.g. mathematics, statistics, computer science etc Extensive professional experience as an IT Data Engineer in creating scalable data solutions Significant knowledge of data engineering processes - ELT / ETL, Batch, Streaming, API, Eventing, Pub/Sub etc. Expert in SQL, Python and other coding languages Significant knowledge in Azure DevOps process Significant knowledge in Data Modelling (Dimension etc) Significant knowledge in Lakehouse concepts and design Knowledge of Azure Cloud Infrastructure and Security Significant Experience with Delta/Iceberg Open Table Format Significant Experience with Data ingestion patterns and Data Engineering Frameworks Experience with troubleshooting via logs and building informative logging into pipelines Deep understanding of data as a product and its value in serving a company Excellent written and verbal communication skills with the ability to effectively communicate complex and technical subject matter to non-specialists Experience in a fast-paced multi-brand industry Strong stakeholder management experience at various levels of an organisation Experience of the analysis of business challenges to define data requirements and process flows #J-18808-Ljbffr