Lead Data Engineer

Lead Data Engineer

London Temporary 57600 - 86400 £ / year (est.)
A

At a Glance

  • Tasks: Lead the modernization of data pipelines and ensure high QA standards.
  • Company: Join a dynamic team working with a Government department on impactful projects.
  • Benefits: Enjoy hybrid working and a competitive pay of £800 a day.
  • Why this job: Be at the forefront of data engineering, shaping best practices and leading an Agile team.
  • Qualifications: Expertise in Python, SQL, jinja, and experience with AWS and CI/CD workflows required.
  • Other info: This is a 3-month contract role with active SC clearance needed.

The predicted salary is between 57600 - 86400 £ per year.

We are looking for an experienced, collaborative, Data Engineer to join the team to scope modernisation of the data pipeline. Specifically, the purpose of this role is to identify how an analytics-engineering-led approach could be implemented technically to ensure there is a robust and maintainable pipeline delivered to high QA standards, how that approach could be congruent with the existing practices of our analytics

  • Excellent python, SQL and jinja skills

  • Understanding and awareness of R

  • Applied automated testing, for example with pytest

  • Familiar with version control tools, such as git.

  • Experience with cloud platforms, ideally AWS

  • Experience of orchestrations tools, ideally airflow

  • Experience of building CI/CD workflows, ideally with GitHub Actions

  • Experience of reviewing, designing and developing data pipelines

  • Experience of using dbt, including implementing dbt best practices

  • Applied data modelling (conceptual, logical, physical) experience

  • Active SC clearance

Desirable

  • Experience of infrastructure as code, ideally Terraform

  • Data Lake Table Formats, such as Iceberg

  • Kubernetes and container-based workflows

  • Orchestration systems, such as Airflow

  • Experience of guiding others to apply best practices and ensuring practices are up to date with latest developments in data engineering

  • Working in or leading an Agile team

Lead Data Engineer required to work with a Government department. This is an initial 3 month contract, paying £800 a day, inside IR35, hybrid working.

To speak to a recruitment expert please contact Mark Birch

Share

Lead Data Engineer employer: Adecco

Join a forward-thinking team as a Lead Data Engineer, where your expertise will directly contribute to the modernization of our data pipeline for a Government department. We offer a collaborative work culture that values innovation and continuous learning, with opportunities for professional growth in a hybrid working environment. Enjoy competitive compensation and the chance to work on impactful projects that uphold high QA standards while utilizing cutting-edge technologies.
A

Contact Detail:

Adecco Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Lead Data Engineer

✨Tip Number 1

Make sure to showcase your experience with cloud platforms, especially AWS. Highlight any specific projects where you implemented data pipelines or orchestration tools like Airflow, as this will demonstrate your hands-on expertise.

✨Tip Number 2

Since the role emphasizes collaboration, be prepared to discuss examples of how you've worked in Agile teams. Share instances where you guided others in applying best practices in data engineering, as this aligns with the leadership aspect of the position.

✨Tip Number 3

Familiarize yourself with dbt and its best practices, as well as automated testing frameworks like pytest. Being able to speak knowledgeably about these tools during discussions will set you apart from other candidates.

✨Tip Number 4

Given the importance of version control in this role, ensure you're comfortable discussing your experience with git and CI/CD workflows, particularly with GitHub Actions. This technical proficiency is crucial for maintaining high QA standards in data pipelines.

We think you need these skills to ace Lead Data Engineer

Python
SQL
Jinja
R
Automated Testing (pytest)
Version Control (Git)
AWS
Orchestration Tools (Airflow)
CI/CD Workflows (GitHub Actions)
Data Pipeline Design and Development
dbt Best Practices
Data Modelling (Conceptual, Logical, Physical)
Active SC Clearance
Infrastructure as Code (Terraform)
Data Lake Table Formats (Iceberg)
Kubernetes
Container-based Workflows
Agile Methodologies
Mentoring and Guiding Best Practices

Some tips for your application 🫡

Tailor Your CV: Make sure your CV highlights your experience with Python, SQL, and Jinja. Include specific examples of data pipelines you've built and any relevant cloud platform experience, especially with AWS.

Craft a Strong Cover Letter: In your cover letter, emphasize your collaborative skills and experience in leading Agile teams. Discuss how you can contribute to modernizing the data pipeline and ensuring high QA standards.

Showcase Relevant Projects: If you have experience with tools like dbt, Airflow, or GitHub Actions, be sure to mention specific projects where you applied these technologies. This will demonstrate your hands-on expertise.

Highlight Your Clearance: Since active SC clearance is required for this role, make sure to clearly state your clearance status in your application. This will help you stand out as a qualified candidate.

How to prepare for a job interview at Adecco

✨Showcase Your Technical Skills

Be prepared to discuss your experience with Python, SQL, and Jinja in detail. Highlight specific projects where you implemented these technologies, especially in the context of building or modernizing data pipelines.

✨Demonstrate Your Understanding of Data Engineering Best Practices

Discuss your familiarity with dbt and how you've applied best practices in your previous roles. Be ready to explain your approach to data modeling and how you ensure high QA standards in your work.

✨Highlight Your Experience with Cloud Platforms

Since experience with AWS is crucial for this role, prepare examples of how you've utilized cloud platforms in your past projects. Discuss any orchestration tools like Airflow that you've used in conjunction with cloud services.

✨Prepare for Questions on Team Collaboration and Leadership

As a Lead Data Engineer, you'll need to guide others and work within an Agile team. Be ready to share experiences where you've led initiatives, mentored colleagues, or contributed to team success through collaboration.

Lead Data Engineer
Adecco Apply now
A
  • Lead Data Engineer

    London
    Temporary
    57600 - 86400 £ / year (est.)
    Apply now

    Application deadline: 2027-01-07

  • A

    Adecco

  • Other open positions at Adecco

    A
    AWS Data Engineer

    Adecco

    Full-Time 60000 - 100000 £ / year (est.)
    A
    Databricks Data Engineer X5

    Adecco

    Full-Time 55000 - 95000 £ / year (est.)
Similar positions in other companies
J
Senior Data Engineer

JSS Search

Full-Time 54000 - 126000 £ / year (est.)
S
Lead Data Engineer

SR2 | Socially Responsible Recruitment | Certified B Corporationâ„¢

Full-Time 80000 - 120000 £ / year (est.)
Europas größte Jobbörse für Gen-Z
discover-jobs-cta
Discover now
>