Data Engineer (,, United Kingdom)

The Green Recruitment Company is working with an Environmental and Sustainability Business that supports and empower their customers journey to net zero. To join their Data-Technology team, we have an opportunity for a Data Engineer to help support the wider business (cross-functional) to meet their reporting and data requirements.About the role:The Data Engineer will be working with the latest innovative technologies, to design, build and maintain data solutions, constructing process to surface data both internally for reporting purposes and externally through the customer portal.The Data Engineer will be responsible for developing scalable data pipelines to integrate diverse data sources whilst ensuring data quality under the framework of a new Data Platform for real time application integration and reporting, and will work closely with business stakeholders to support data-driven decision making by delivering clean, well-structured datasets that can be utlised for reporting purpose in a performent, secure way.Key responsibilities:Taking full ownership of assigned projects and BAU tasks.Maintaining current pipelines within Azure ADF and Synapse Analytics.Build a process of transforming raw data from various CRM system into a harmonised and curated layer.Develop the usage of event driven topics for usage of various subscribers.Investigate and document Architectural Spikes to help foster best practice within the Data Team.Developing and creating data science tools to give a deeper understanding of the customer book.Recording and updating of work on Project Management System (Azure DevOps).Own and enhance the BAU runbook for engineering operationsDevelop the instrumentation and monitoring of IT automated tasksTaking a lead in the engineering function of the data teamRequirements:Qualifications: Bachelor’s degree or above in Computing or Software Development or similarExperience required:3-5 years\’ Cloud-based Data Engineering experience,Previous experience of formal methodologies with data engineeringExperience leading or working in an engineering team or functionPrevious experience of using the Azure StackExperience working in a proactive analytics functionExperience of working in the Utilities sectorExperience leading technical projectsSkills & Technologies required:Proficiency in cloud-based data engineering tools (ADF, Synapse Analytics, S3, Lamda)Proficiency in using PySpark notebooks for ELT.Fostering and cultivating a culture of best practicesStrong analytical and problem-solving skills.Ability to work independently and as part of a functional and cross-functional teamExcellent communication and documentation skills.Proven ability to design, evaluate and score engineering optionsFormal data engineering qualificationOn offer: Salary £42 000 – £45 000 (depending on experience) with an attractive company benefit package & career development