Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the design and optimisation of large-scale cloud data platforms using Azure and Databricks.
- Company: Join a renowned Global Consulting firm with a focus on insights and data.
- Benefits: Competitive salary, 15% cash flex, bonus, and hybrid working options.
- Why this job: Shape the future of cloud data engineering in a dynamic, regulated environment.
- Qualifications: Expertise in Azure Data Services, Databricks, and strong programming skills in Python.
- Other info: Collaborate with diverse teams and tackle complex technical challenges.
The predicted salary is between 80000 - 90000 £ per year.
Fantastic opportunity to join a well-known Global Consulting firm's Insights and Data Practice. Our client is seeking an exceptional Lead Azure Databricks Engineer to architect, build, and optimise enterprise-scale cloud data platforms. This hands-on leadership role is central to shaping their Azure and Databricks strategy, enabling advanced analytics, regulatory compliance, and robust engineering across the organisation.
The ideal candidate brings deep technical expertise, strong delivery ownership, and proven experience operating within the highly regulated Lloyd's of London market.
Your Role:
- Design, develop, and optimise large-scale cloud data platforms using Azure Data Factory, Data Lake, Key Vault, Azure Functions, Databricks, Delta Lake, PySpark, and Unity Catalog.
- Collaborate with underwriting, actuarial, Delegated Authority, bordereaux, exposure management, reinsurance, finance, and Solvency II teams to meet Lloyd's market and regulatory requirements.
- Translate business needs into scalable cloud data architectures by partnering with architects, SMEs, product owners, and senior leaders.
- Own and resolve complex technical challenges while championing CI/CD automation, cloud-native best practices, data lifecycle management, and high engineering standards.
- Oversee end-to-end data engineering delivery, ensuring pipeline reliability, observability, performance, resilience, and continuous improvement.
Your Skills:
- Expert-level hands-on experience with Azure Data Services and Databricks in enterprise, highly regulated environments.
- Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns, distributed compute, data modelling, and performance optimisation.
- Strong programming skills in Python, PySpark, and Spark SQL, with experience implementing CI/CD pipelines (Azure DevOps, branching/merging, automation).
- Solid knowledge of data governance, lineage, access controls, secure cloud engineering, and FinOps principles.
- Exceptional communication and leadership skills with the ability to influence senior stakeholders and deliver results in fast-paced, high-expectation environments.
Lead Azure Databricks Engineer employer: Damia Group Ltd
Contact Detail:
Damia Group Ltd Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Azure Databricks Engineer
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, attend meetups, and engage with professionals on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure and Databricks. This will give potential employers a tangible sense of what you can bring to the table.
✨Tip Number 3
Prepare for interviews by practising common technical questions related to Azure Data Services and Databricks. We recommend doing mock interviews with friends or using online platforms to get comfortable with the format.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive about their job search.
We think you need these skills to ace Lead Azure Databricks Engineer
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Lead Azure Databricks Engineer role. Highlight your experience with Azure Data Services and Databricks, and don’t forget to mention any relevant projects that showcase your skills in cloud data platforms.
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you’re the perfect fit for this role. Mention your hands-on leadership experience and how you’ve tackled complex technical challenges in the past.
Showcase Your Technical Skills: Be specific about your technical expertise in your application. Include details about your programming skills in Python and PySpark, and any experience with CI/CD pipelines. This will help us see how you can contribute to our team right away!
Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It’s the best way for us to receive your application and keep track of all the amazing candidates like you!
How to prepare for a job interview at Damia Group Ltd
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure Data Services and Databricks. Brush up on your knowledge of Delta Lake, Medallion architecture, and performance optimisation techniques. Being able to discuss these topics confidently will show that you’re the expert they’re looking for.
✨Showcase Your Leadership Skills
This role is all about leading teams and influencing stakeholders. Prepare examples from your past experiences where you’ve successfully led projects or resolved complex technical challenges. Highlight your ability to communicate effectively with both technical and non-technical teams.
✨Understand the Business Context
Familiarise yourself with the Lloyd's of London market and its regulatory requirements. Be ready to discuss how your technical skills can help meet these needs. This shows that you’re not just a tech whiz but also understand the bigger picture.
✨Prepare for Scenario-Based Questions
Expect questions that ask how you would handle specific challenges related to data engineering delivery and CI/CD automation. Think through potential scenarios and how you would approach them, demonstrating your problem-solving skills and technical expertise.