Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead a team to create innovative data solutions using Azure and Databricks.
- Company: Join a forward-thinking tech company with a hybrid work culture.
- Benefits: Enjoy competitive pay, health perks, and opportunities for professional growth.
- Other info: Dynamic role with excellent career advancement opportunities in a collaborative environment.
- Why this job: Make a real impact in data engineering while working with cutting-edge technology.
- Qualifications: Strong experience in Azure, Databricks, and data engineering practices required.
The predicted salary is between 70000 - 90000 £ per year.
Location: London, Watford or Bristol (Hybrid working options available)
The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions.
- Creating innovative solution designs for domain and enterprise data products.
- Overseeing Data Analysts to support detailed data discovery.
- Overseeing data modelling for Finance and Enterprise data products.
- Leading Product Increment planning to break down solutions into Features and Epics for incremental delivery.
- Designing and implementing scalable data solutions on Azure and Databricks within the assigned domain.
- Ensuring appropriate engineering standards are applied to maintain data quality, performance and reliability.
- Lead solution design for Finance and Enterprise data products, ensuring alignment with enterprise patterns and guardrails.
- Direct and collaborate with Data Analysts on detailed data discovery, source understanding and requirements refinement.
- Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required.
- Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake).
- Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established patterns.
- Support monitoring, logging and basic cost optimisation for the team’s data products.
- Support the development of DevOps practices within the team, including reducing technical debt and improving automation over time.
Lead Data Engineers are expected to have strong capability in at least three of the following areas of engineering practice:
- Automation including testing of data pipelines and data products.
- Awareness of security principles and best practices to ensure secure data solutions.
- Commitment to continuous learning and staying current with Azure, Databricks and data engineering trends.
- Strong experience working within an agile development methodology, ideally Scaled Agile (SAFe or similar).
- Excellent time and self-management through effective planning and prioritisation of tasks.
- Proven and demonstrable data engineering capability.
Data Engineer (New Technology / Microsoft):
- Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous).
- Experience contributing to CI/CD pipelines (Azure DevOps, GitHub Actions, Terraform).
- Scripting and programming skills (Python advantageous).
- Good understanding of DevOps and automation concepts.
- Experience working with Databricks and Azure in a product or Scaled Agile delivery environment.
- Degree level IT or technical/scientific subject (or equivalent experience).
- Microsoft Azure Data Engineer or Solutions Architect certification (desirable).
- Databricks Certified Data Engineer or Machine Learning Associate (desirable).
- Experience with streaming solutions (Kafka, Event Hubs, Spark Streaming) (desirable).
- Knowledge of machine learning and AI on Databricks (desirable).
Lead Engineer/Data Engineer employer: Canada Life
Contact Detail:
Canada Life Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Engineer/Data Engineer
✨Tip Number 1
Network like a pro! Get out there and connect with folks in the industry. Attend meetups, webinars, or even just grab a coffee with someone who’s already in the role you want. You never know who might have the inside scoop on job openings!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure and Databricks. This is your chance to demonstrate your hands-on experience and technical leadership. Make it easy for potential employers to see what you can do!
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Be ready to discuss your experience with CI/CD pipelines, data modelling, and DevOps practices. Practice common interview questions and think about how you can relate your past experiences to the role.
✨Tip Number 4
Don’t forget to apply through our website! We’re always on the lookout for talented individuals like you. Plus, applying directly can sometimes give you a better chance of getting noticed by the hiring team. So, what are you waiting for? Go for it!
We think you need these skills to ace Lead Engineer/Data Engineer
Some tips for your application 🫡
Tailor Your CV: Make sure your CV reflects the skills and experiences that match the Lead Engineer/Data Engineer role. Highlight your expertise in Azure, Databricks, and data engineering to catch our eye!
Craft a Compelling Cover Letter: Use your cover letter to tell us why you're the perfect fit for this role. Share specific examples of your past projects and how they relate to the responsibilities listed in the job description.
Showcase Your Technical Skills: Don’t hold back on showcasing your technical prowess! Mention your experience with CI/CD pipelines, automation, and any relevant certifications you have. We love seeing candidates who are passionate about their craft.
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way to ensure your application gets into the right hands and shows us you’re serious about joining the StudySmarter team!
How to prepare for a job interview at Canada Life
✨Know Your Tech Inside Out
Make sure you brush up on your Azure cloud services and Databricks knowledge. Be ready to discuss specific projects where you've implemented these technologies, as well as any challenges you faced and how you overcame them.
✨Showcase Your Leadership Skills
As a Lead Engineer, you'll need to demonstrate your ability to lead cross-functional teams. Prepare examples of how you've successfully guided teams in the past, especially in agile environments, and how you’ve contributed to CI/CD pipelines.
✨Prepare for Scenario-Based Questions
Expect questions that ask you to solve hypothetical problems related to data engineering and DevOps practices. Think through potential scenarios involving data quality, performance issues, or automation challenges, and be ready to explain your thought process.
✨Highlight Continuous Learning
The tech world is always evolving, so show your commitment to staying current with trends in Azure and Databricks. Mention any recent courses, certifications, or projects that reflect your dedication to continuous improvement in data engineering.