Azure Data Engineer (Fully Remote) (Permanent)

A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs.

The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering.

Key responsibilities include:

• Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components and products.
• Use a range of coding tools and languages as required.
• Work closely with colleagues across the Data & Insight Unit to effectively translate requirements into solutions, and accurately communicate across technical and non-technical stakeholders as well as facilitating discussions within a multidisciplinary team.
• Deliver robust, supportable and sustainable data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future proof.
• Understand the concepts and principles of data modelling and produce, maintain and update relevant physical data models for specific business needs, aligning to the enterprise data architecture standards.
• Design and implement data solutions for the ingest, storage and use of sensitive data within the organisation, including designing and implementing row and field-level controls as needed to appropriately control, protect and audit such data.
• Work collaboratively, sharing information appropriately and building supportive, trusting and professional relationships with colleagues and a wide range of people within and outside of the organisation.
• Design and undertake appropriate quality control and assurance for delivery of output.
• Keep abreast of opportunities for innovation with new tools and uses of data.

Experience required:

• Working with Database technologies such as SQL Server, and Data Warehouse Architecture with knowledge of big data, data lakes and NoSQL.
• Following product/solution development lifecycles using frameworks/methodologies such as Agile, SAFe, DevOps and use of associated tooling.
• Demonstrable experience writing ETL scripts and code to ensure the ETL processes perform optimally.
• Experience in other programming languages for data manipulation (e.g., Python, Scala).
• Extensive experience of data engineering and the development of data ingest and transformation routines and services using modern, cloud-based approaches and technologies.
• Understanding of the principles of data modelling and data flows with ability to apply this to design of data solutions.
• Experience of supporting and enabling AI technologies.
• Implementing data flows to connect operational systems, data for analytics and BI systems.
• Translating business requirements into solution design and implementation.
• Knowledge and experience of data security and data protection.
• Proven ability to understand stakeholder needs, manage their expectations and influence at all levels on the use of data and insight.