Data Engineer (Azure)

Our client are revolutionising the Automotive Industry and require a Data Engineer to join their growing team in an exciting scale up phase. The role: The role of the Data Engineer is to deliver data products supporting a wide range of business demands. Working with the Data Architect, the data engineer will be responsible for the implementation and management of data solutions on our cloud infrastructure. The engineer will create and maintain data pipelines, manage storage solutions, undertake data processing, data modelling and enabling data to support effective decision making. Core Requirements: Strategy & Planning •Work with the data architect to deliver data solutions in line with the overall strategy. •Create short-term tactical solutions to achieve long-term objectives and an overall data management roadmap. Acquisition & Deployment •Ensure the success of enterprise-level application data architecture for a wide range of business areas e.g. CRM, PLM, ERP, Aftersales/Dealer Management, Finance & HRIS Operational Management •Management of data related solutions within Microsoft Azure and other future cloud platforms if required including but not limited to source data acquisition, data movement, data modelling. •Management of Azure SQL, Data Lake / One Lake storage, COSMOS DB, Blob Storage and other data related storage activities •Management of data acquisition and integration for Azured Data Lake covering Azure Data Bricks, ADF and any required 3rd party tools •Delivery of solutions using appropriate tools, software, applications, and systems to support data technology goals. •Active maintenance of corporate data models and metadata as part of solution delivery •Collaborate with project managers and business unit leaders for all projects involving enterprise data. •Address data-related problems regarding systems integration, compatibility, and multiple-platform integration. •Develop and implement key components as needed to create testing criteria to guarantee the fidelity and performance of data architecture. •Document the data architecture and environment to maintain a current and accurate view of all data held by our client •Identify and develop opportunities for data reuse •Support data lifecycle management initiatives for retention, archiving and destruction in line with regulatory requirements. Knowledge & Experience •6 year’ work experience managing and delivering SQL Server solutions including Azure SQL with strong understanding of relational data structures, theories, principles, and practices. •At least 3 years experience implementing and delivering Azure solutions for ETL/ELT, Lambda and Kappa architectures. •Management of Azure SQL, Data Lake / One Lake storage, COSMOS DB, Blob Storage and other data related storage activities •Hands-on knowledge of enterprise repository tools, data modelling tools, data mapping tools, and data profiling tools. •Hands-on experience implementing data architecture and structures from gathering business requirements to technical implementation. •Hands-on experience implementing modern data structures/databases e.g. key-value stores. •Experienced with establishing changed data capture (CDC) solutions where source systems do not support this •Experienced with mastering techniques to master data from multiple sources and cleansing data to create a reliable “golden record”. •Demonstrated expertise with repository creation, and data and information system life cycle methodologies •Experience designing and delivering analytical solutions e.g. DWH, Business Analytics, Statistics and Machine Learning •Excellent client/user interaction skills to determine requirements. •Working technical knowledge of applications and platforms, including Azure, AWS, SAP & Salesforce •Experience with data processing flowcharting techniques. •Experienced at tuning solutions to manage cloud compute costs and balance scalability and performance. •Desirable hands-on experience modelling solutions in PLM, Manufacturing and/or telematics organisations