At a Glance
- Tasks: Lead the modernization of data pipelines and ensure high QA standards.
- Company: Join a dynamic team working with a Government department on impactful projects.
- Benefits: Enjoy hybrid working and a competitive pay of £800 a day.
- Why this job: Be at the forefront of data engineering, shaping best practices and leading an Agile team.
- Qualifications: Expertise in Python, SQL, jinja, and experience with AWS and CI/CD workflows required.
- Other info: This is a 3-month contract role with active SC clearance needed.
The predicted salary is between 57600 - 86400 £ per year.
We are looking for an experienced, collaborative, Data Engineer to join the team to scope modernisation of the data pipeline. Specifically, the purpose of this role is to identify how an analytics-engineering-led approach could be implemented technically to ensure there is a robust and maintainable pipeline delivered to high QA standards, how that approach could be congruent with the existing practices of our analytics
-
Excellent python, SQL and jinja skills
-
Understanding and awareness of R
-
Applied automated testing, for example with pytest
-
Familiar with version control tools, such as git.
-
Experience with cloud platforms, ideally AWS
-
Experience of orchestrations tools, ideally airflow
-
Experience of building CI/CD workflows, ideally with GitHub Actions
-
Experience of reviewing, designing and developing data pipelines
-
Experience of using dbt, including implementing dbt best practices
-
Applied data modelling (conceptual, logical, physical) experience
-
Active SC clearance
Desirable
-
Experience of infrastructure as code, ideally Terraform
-
Data Lake Table Formats, such as Iceberg
-
Kubernetes and container-based workflows
-
Orchestration systems, such as Airflow
-
Experience of guiding others to apply best practices and ensuring practices are up to date with latest developments in data engineering
-
Working in or leading an Agile team
Lead Data Engineer required to work with a Government department. This is an initial 3 month contract, paying £800 a day, inside IR35, hybrid working.
To speak to a recruitment expert please contact Mark Birch
Share
Lead Data Engineer employer: Adecco
Contact Detail:
Adecco Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer
✨Tip Number 1
Make sure to showcase your experience with cloud platforms, especially AWS. Highlight any specific projects where you implemented data pipelines or orchestration tools like Airflow, as this will demonstrate your hands-on expertise.
✨Tip Number 2
Since the role emphasizes collaboration, be prepared to discuss examples of how you've worked in Agile teams. Share instances where you guided others in applying best practices in data engineering, as this aligns with the leadership aspect of the position.
✨Tip Number 3
Familiarize yourself with dbt and its best practices, as well as automated testing frameworks like pytest. Being able to speak knowledgeably about these tools during discussions will set you apart from other candidates.
✨Tip Number 4
Given the importance of version control in this role, ensure you're comfortable discussing your experience with git and CI/CD workflows, particularly with GitHub Actions. This technical proficiency is crucial for maintaining high QA standards in data pipelines.
We think you need these skills to ace Lead Data Engineer
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience with Python, SQL, and Jinja. Include specific examples of data pipelines you've built and any relevant cloud platform experience, especially with AWS.
Craft a Strong Cover Letter: In your cover letter, emphasize your collaborative skills and experience in leading Agile teams. Discuss how you can contribute to modernizing the data pipeline and ensuring high QA standards.
Showcase Relevant Projects: If you have experience with tools like dbt, Airflow, or GitHub Actions, be sure to mention specific projects where you applied these technologies. This will demonstrate your hands-on expertise.
Highlight Your Clearance: Since active SC clearance is required for this role, make sure to clearly state your clearance status in your application. This will help you stand out as a qualified candidate.
How to prepare for a job interview at Adecco
✨Showcase Your Technical Skills
Be prepared to discuss your experience with Python, SQL, and Jinja in detail. Highlight specific projects where you implemented these technologies, especially in the context of building or modernizing data pipelines.
✨Demonstrate Your Understanding of Data Engineering Best Practices
Discuss your familiarity with dbt and how you've applied best practices in your previous roles. Be ready to explain your approach to data modeling and how you ensure high QA standards in your work.
✨Highlight Your Experience with Cloud Platforms
Since experience with AWS is crucial for this role, prepare examples of how you've utilized cloud platforms in your past projects. Discuss any orchestration tools like Airflow that you've used in conjunction with cloud services.
✨Prepare for Questions on Team Collaboration and Leadership
As a Lead Data Engineer, you'll need to guide others and work within an Agile team. Be ready to share experiences where you've led initiatives, mentored colleagues, or contributed to team success through collaboration.