At a Glance
- Tasks: Lead a team to enhance and manage a next-gen data lake using AWS tools.
- Company: Join a leading workplace pensions provider in the heart of London.
- Benefits: Enjoy a dynamic work environment with opportunities for growth and innovation.
- Why this job: Be at the forefront of data engineering, shaping the future of data management.
- Qualifications: 7/8 years in Python, SQL, AWS; leadership experience required.
- Other info: Engage with C-suite stakeholders and drive best practices in data engineering.
The predicted salary is between 48000 - 84000 £ per year.
Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake hosted in AWS which makes use of Dremio, Data Mesh architecture and a wide range of AWS tools (S3, Glue, Step Functions etc.). With the infrastructure of this new Data Lake in place, there is now a focus on enhancing the data stored within (via monitoring, cleaning and, as well as a requirement to design, build and implement robust ETL pipelines for effective integration with the wider business. As a Lead Engineer, you will also be responsible for overseeing a small team of Data Engineers, setting and driving best practises and standards, ensuring project delivery is kept on track and regularly engaging with stakeholders up to C-suite for feedback/updates. This will also involve working directly alongside the Head of Data Platforms to ensure ongoing engineering work is aligned to overall architecture and roadmap, as well as future project planning. If you demonstrate the following skillset, please do apply! 7/8 years’ experience in Python programming, particularly around data analysis, automation and the building of data pipelines (as well as an understanding of data warehousing concepts) Strong SQL skills, especially in relation to ETL processes and data management (querying, cleaning, storing) Experience working with and deploying to AWS cloud (having worked with any/all of S3, Glue, Lambda, Step Functions etc.) Usage of PowerBI for data visualization Experience of both Dremio and Data Mesh Architecture Prior experience of leading software engineering teams (including line management) Clear, confident communications with previous experience of working directly with business users
Lead Data Engineer employer: Cornwallis Elt
Contact Detail:
Cornwallis Elt Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer
✨Tip Number 1
Make sure to showcase your experience with AWS tools like S3 and Glue. Highlight any specific projects where you've implemented these technologies, as this will demonstrate your hands-on expertise.
✨Tip Number 2
Emphasize your leadership skills by discussing any previous experiences where you managed a team or led projects. This is crucial since the role involves overseeing a small team of Data Engineers.
✨Tip Number 3
Prepare to discuss your approach to building ETL pipelines and data warehousing concepts. Being able to articulate your methodology will show that you understand the core responsibilities of the role.
✨Tip Number 4
Since the role requires clear communication with stakeholders, think of examples where you've successfully engaged with business users or C-suite executives. This will highlight your ability to bridge technical and business needs.
We think you need these skills to ace Lead Data Engineer
Some tips for your application 🫡
Highlight Relevant Experience: Make sure to emphasize your 7/8 years of experience in Python programming and SQL skills. Detail specific projects where you built data pipelines or worked with ETL processes, as this aligns closely with the job requirements.
Showcase Leadership Skills: Since the role involves overseeing a team, include examples of your previous leadership experience. Mention any instances where you set best practices, managed project delivery, or engaged with stakeholders, especially at the C-suite level.
Demonstrate Technical Proficiency: Clearly outline your experience with AWS tools like S3, Glue, and Lambda. If you've worked with Dremio and Data Mesh architecture, be sure to highlight that as well, as it is crucial for this position.
Tailor Your Application: Customize your CV and cover letter to reflect the specific skills and experiences mentioned in the job description. Use keywords from the listing to ensure your application stands out to hiring managers.
How to prepare for a job interview at Cornwallis Elt
✨Showcase Your Technical Skills
Be prepared to discuss your experience with Python, SQL, and AWS in detail. Highlight specific projects where you built data pipelines or worked with ETL processes, as this will demonstrate your hands-on expertise.
✨Demonstrate Leadership Experience
Since the role involves overseeing a team, share examples of how you've successfully led engineering teams in the past. Discuss your approach to setting best practices and ensuring project delivery.
✨Engage with Stakeholders
Prepare to talk about your experience communicating with stakeholders, especially at the C-suite level. Provide examples of how you've gathered feedback and aligned engineering work with business needs.
✨Understand Data Architecture
Familiarize yourself with Data Mesh architecture and Dremio, as these are key components of the role. Be ready to discuss how you would enhance the data lake and implement robust ETL pipelines.