Lead Data Engineer Python, Spark, AWS , ETL pipelines

Get AI-powered advice on this job and more exclusive features.

Lead Data Engineer

Job Location: London (Remote)

Eligibility for SC clearance is required.

Permanent role – 90k GBP

We are looking for a dedicated professional with substantial experience in big data technologies to join our team. Your collaborative skills will be key as you work alongside stakeholders, data architects, and data scientists to enhance data quality across our projects.

We value your expertise in ETL tools, including Apache Kafka, Spark, and Airflow, and your strong programming skills in Python, Scala, and SQL will further enrich our capabilities. Additionally, your experience in implementing data pipelines utilizing cloud-native services on AWS will be invaluable.

Your comprehensive knowledge of AWS services such as API Gateway, Lambda, Redshift, Glue, and CloudWatch will enable us to optimize our data processes.

We look forward to your contributions in making meaningful advancements in our customers\’ data initiatives.

Responsibilities

• Are you currently holding SC clearance or can you become eligible to obtain it? Your clearance is essential for the role.
• If you are a qualified Lead AWS Data Engineer/Architect, please contact me.

Seniority Level

Associate

Employment Type

Full-time

Job Function

Information Technology, Analyst, and Consulting

Industries

IT Services and IT Consulting, IT System Data Services, and Data Infrastructure and Analytics

#J-18808-Ljbffr