Data Engineer

Introduction

Infinigate Group are a leading, pan-EMEA distributer, specialising in total cyber security solutions and services. With 4 UK offices based in London, Woking, South Cerney and Fareham, we take pride in providing unrivalled support and value for our vendor and reseller partner communities.

Our team at Infinigate consists of IT security experts as well as highly skilled support staff. With the right people in place, our laser focus is on positive customer outcomes and long-term stable partnerships with our vendors. To deliver this objective we adopt a flat hierarchy, high performing teams, efficient decision-making processes and a nurturing and learning environment which rewards performance.

Role Purpose

Infinigate Group are seeking a driven and innovative Data Engineer to joining an expanding international BI & Analytics Team, in the UK. This dynamic role will collaborate with a wider successful team in which personal development takes front stage! To be successful in this role, you will feel confident using tools such as Power Platform, Databricks and ADF.

We are pleased to offer this role as predominantly remote, with the option to commute to our closest office. Our offices in the UK are based in London, Woking, South Cerny and Fareham.

Duties & Responsibilities

• Data Pipeline development/orchestration/maintenance

• Creating robust, fit-for-purpose data modelling solutions to address multiple business cases

• Root cause analysis and pro-active investigation to identify potential issues and optimize ETL pipelines, notify end-users and propose adequate solutions

• Prepare documentation for further reference

General Skills

Software Knowledge

• Demonstratable delivery experience using Azure Databricks

• Solid delivery experience using ADF, ADLS Gen2, and the Azure Cloud Ecosystem

• Solid SQL skills – Querying syntax, DDL and DML statements

• Solid Python skills – able to use the Python programming concepts in Databricks Notebooks for data loading, transformation and exploration including familiarity with Pandas

• Strong understanding of core Databricks and Spark concepts such as Delta Live Tables, Delta Sharing, Medallion Architecture, Dataframes, Workflows, Unity Catalogue, Delta Live Tables, and UDF’s

• Understands the key principals of Data Warehouse design including Star Schema, F&D design, Dimension and Fact loading patterns, SCD and CDC concepts

• Experience with use of MS DevOps for Scrum management and with Repos and use of CI / CD Pipelines between Azure and DevOps

• Proven track record in a data engineering role where the focus has been on developing data pipelines, data warehouses, data lakehouses, and similar data repositories for BI, Reporting and Analytics use

Certifications (Desirable)

• Any relevant Azure certifications / exams such as: AZ-900, DP-900, DP-203, or DP-500

• Any relevant Databricks certifications: Lakehouse Data Engineer Associate, : Lakehouse Data Engineer Professional

Personal requirements

Infinigate’s values underpin a strong collaborative working culture and successful inclusive working environment.

• Capability to analyze and troubleshoot complicated data sets

• Outstanding verbal and written communication abilities

• Outstanding interpersonal skills

• Self-Starter

• Strong conceptual abilities

• Excellent multitasking abilities

• Exceptional analytical abilities

• Quickly learn new data tools and ideas

High attention to detail

Benefits

• £45,000 – £55,000 salary per annum

• 25 days annual leave rising to 28 days with length of service, plus bank holidays.

• Day off on your birthday.

• 2 paid volunteer days per year

• Additional holiday purchase scheme

• Life assurance of 4 x basic salary and group income protection from start date

• 5% employer matched pension contributions after 3 months service.

• Individual cover for private medical insurance and healthcare cash plan following successful completion of probationary period.

• Hybrid working arrangements and standard office working hours are 9am – 5.30pm

• Employee assistance programme for practical and emotional support.

• Free parking and complimentary refreshments onsite.

Infinigate Group are committed to creating a diverse and inclusive workplace where differences are not only accepted but also valued and appreciated. If any reasonable adjustments would support you through the recruitment process, then please get in touch at JobsUK@infinigate.com

If you are interested in applying for this role or have any additional queries on the role, please submit your CV quoting ‘Data Engineer’ to JobsUK@Infinigate.com.