Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead a team to enhance and manage a next-gen data lake and build robust ETL pipelines.
- Company: Join a top workplace pensions provider in London, focused on innovative data solutions.
- Benefits: Enjoy a dynamic work environment with opportunities for growth and collaboration.
- Why this job: Be at the forefront of data engineering, shaping the future of data management and integration.
- Qualifications: 7-8 years in Python, SQL, AWS; experience leading teams and working with Dremio.
- Other info: Engage with C-suite stakeholders and drive best practices in a cutting-edge tech environment.
The predicted salary is between 43200 - 72000 £ per year.
Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London
A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team has recently built out a next-gen data lake hosted in AWS which makes use of Dremio, Data Mesh architecture, and a wide range of AWS tools (S3, Glue, Step Functions, etc.).
With the infrastructure of this new Data Lake in place, there is now a focus on enhancing the data stored within (via monitoring, cleaning) and a requirement to design, build, and implement robust ETL pipelines for effective integration with the wider business.
As a Lead Engineer, you will also be responsible for overseeing a small team of Data Engineers, setting and driving best practices and standards, ensuring project delivery is kept on track, and regularly engaging with stakeholders up to C-suite for feedback/updates. This will also involve working directly alongside the Head of Data Platforms to ensure ongoing engineering work is aligned to overall architecture and roadmap, as well as future project planning.
If you demonstrate the following skillset, please do apply!
- 7/8 years’ experience in Python programming, particularly around data analysis, automation, and the building of data pipelines (as well as an understanding of data warehousing concepts)
- Strong SQL skills, especially in relation to ETL processes and data management (querying, cleaning, storing)
- Experience working with and deploying to AWS cloud (having worked with any/all of S3, Glue, Lambda, Step Functions, etc.)
- Usage of PowerBI for data visualization
- Experience of both Dremio and Data Mesh Architecture
- Prior experience of leading software engineering teams (including line management)
- Clear, confident communications with previous experience of working directly with business users
#J-18808-Ljbffr
Lead Data Engineer - Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL employer: Cornwallis Elt Ltd
Contact Detail:
Cornwallis Elt Ltd Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer - Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL
✨Tip Number 1
Make sure to showcase your experience with AWS tools like S3 and Glue during networking events or conversations. This will help you connect with others in the industry and demonstrate your hands-on knowledge.
✨Tip Number 2
Engage with online communities focused on Data Engineering, especially those discussing Data Mesh and Dremio. Participating in discussions can help you stay updated and may lead to valuable connections.
✨Tip Number 3
Consider creating a portfolio that highlights your projects involving ETL pipelines and data warehousing. This tangible evidence of your skills can set you apart when discussing your experience with potential employers.
✨Tip Number 4
Prepare to discuss your leadership style and experiences in managing teams. Being able to articulate how you've driven best practices and project delivery will be crucial in interviews for this role.
We think you need these skills to ace Lead Data Engineer - Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL
Some tips for your application 🫡
Highlight Relevant Experience: Make sure to emphasize your 7/8 years of experience in Python programming and data analysis. Detail your work with ETL processes and data management, showcasing specific projects where you built data pipelines.
Showcase AWS Proficiency: Clearly outline your experience with AWS tools such as S3, Glue, and Lambda. Mention any specific projects where you deployed solutions in the AWS cloud, as this is crucial for the role.
Demonstrate Leadership Skills: Since the position involves overseeing a team, highlight your previous experience in leading software engineering teams. Provide examples of how you set best practices and drove project delivery.
Communicate Effectively: Given the need for clear communication with stakeholders, include examples of how you've successfully engaged with business users and C-suite executives in past roles. This will show your ability to bridge technical and business needs.
How to prepare for a job interview at Cornwallis Elt Ltd
✨Showcase Your Technical Skills
Be prepared to discuss your experience with Python, SQL, and AWS in detail. Highlight specific projects where you've built data pipelines or worked with ETL processes, as this will demonstrate your hands-on expertise.
✨Demonstrate Leadership Experience
Since the role involves overseeing a team, share examples of how you've led engineering teams in the past. Discuss your approach to setting best practices and ensuring project delivery, as well as how you engage with stakeholders.
✨Understand Data Mesh and Dremio
Familiarize yourself with Data Mesh architecture and Dremio's functionalities. Be ready to explain how these concepts can enhance data management and integration within a business context.
✨Prepare for Behavioral Questions
Expect questions about your communication style and how you handle feedback from C-suite stakeholders. Prepare examples that showcase your ability to communicate complex technical concepts clearly and effectively.
