Data Engineer
The following information provides an overview of the skills, qualities, and qualifications needed for this role.
6 Month Contract
Location: London (Onsite 4 days a week)
Rate: Β£700 - Β£800 per day (INSIDE IR35)
Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance
We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will be joining an established defence programme requiring additional engineering support across an existing data platform.
You will be responsible for building, maintaining and improving new and existing data pipelines within a secure MoD environment.
Due to the nature of the work you will be required to work on site in London 4 days a week.
Key Responsibilities
Build and maintain robust data pipelines using Python
Work across Azure environments on the low side
Support data engineering workloads within Kubernetes environments on the high side
Develop and maintain workflows using Apache Airflow
Work with Apache Spark for large-scale data processing
Support the ongoing development and improvement of established data pipelines
Help ensure data remains within MoD-owned infrastructure in line with data governance requirements
Work within an existing long-running programme requiring additional delivery capacity
Essential Skills
Active xgikmsk DV Clearance
Strong Python data engineering experience
Experience with Azure
Strong knowledge of Kubernetes
Experience with Apache Airflow
Experience with Apache Spark
Strong background building and maintaining production data pipelines
Desirable
Previous experience working within a Palantir environment
Experience delivering data solutions within secure defence or government environments
Data Engineer in Wandsworth employer: Data Careers
Join a dynamic and innovative IT consultancy in Northfleet, where collaboration and inclusivity are at the heart of our work culture. We offer competitive salaries, bonuses, and a flexible working arrangement that allows you to balance office and home life effectively. With a strong focus on employee growth and development, we provide ample opportunities for you to advance your career while making a meaningful impact in the industry.