At a Glance
- Tasks: Lead the design and optimisation of cloud data platforms using Azure technologies.
- Company: Join a leading firm in the Lloyd's of London market with a focus on innovation.
- Benefits: Hybrid work model, competitive salary, and opportunities for professional growth.
- Other info: Collaborative culture with a focus on continuous improvement and mentorship.
- Why this job: Shape the future of cloud data strategy and make a real impact in a dynamic environment.
- Qualifications: Expertise in Azure Data Services, Databricks, and strong Python skills required.
The predicted salary is between 80000 - 100000 £ per year.
We are seeking an outstanding Lead Azure Databricks Engineer to own the design, build, optimisation and governance of our enterprise cloud data platforms. This is a senior, fully hands-on engineering position requiring deep technical expertise, strong delivery capability and experience operating within the Lloyd's of London market and its regulatory demands. You will shape the future of our cloud data strategy, enabling advanced analytics and building secure, scalable and highly performant data solutions across the organisation.
Responsibilities
- Lead the development, optimisation and governance of large-scale data platforms using Azure Data Factory, Data Lake, Key Vault, Azure Functions, Databricks, Delta Lake, PySpark and Unity Catalog.
- Partner closely with underwriting, actuarial, delegated authority, bordereaux, exposure management, reinsurance, finance, Solvency II and risk teams to deliver solutions aligned to Lloyd's of London regulatory and operational requirements.
- Translate complex business needs into scalable cloud data architectures in partnership with architects, SMEs and product owners.
- Resolve complex technical challenges rapidly and decisively, consistently delivering high-quality outcomes.
- Champion engineering best practices including design patterns, data lifecycle management, CI/CD automation and cloud-native methodologies.
- Provide hands-on technical leadership, mentorship and uplift engineering capability across the team.
- Drive continuous improvement across performance, cost optimisation, reliability and resilience.
- Oversee end-to-end data engineering delivery ensuring quality, observability, robustness and compliance.
Qualifications
- Expert-level knowledge of Azure Data Services and Databricks within enterprise environments.
- Deep understanding of Delta Lake, Medallion architecture, distributed compute, Lakehouse patterns, data modelling and performance optimisation.
- Strong Python, PySpark and SQL experience, with hands-on implementation of CI/CD for data solutions using Azure DevOps.
- Strong understanding of data governance, lineage, access management, FinOps and secure cloud engineering.
- Excellent communication skills with the ability to confidently engage senior stakeholders and simplify complex technical concepts.
- Proven ability to take ownership, deliver at pace and operate effectively in high-pressure, high-expectation environments.
- Experience working within or delivering solutions for the Lloyd's of London market or similarly regulated environments.
Azure Databricks Engineer employer: Lloyd's
As a Lead Azure Databricks Engineer at our company, you will be part of a dynamic and innovative team that thrives on collaboration and excellence. We offer a hybrid work model with two days in our London office, fostering a vibrant work culture that values employee growth through mentorship and hands-on leadership opportunities. With a focus on advanced analytics and cloud data strategy, you will play a pivotal role in shaping the future of our enterprise data platforms while enjoying the unique advantages of working within the prestigious Lloyd's of London market.
StudySmarter Expert Advice🤫
We think this is how you could land Azure Databricks Engineer
✨Tip Number 1
Network like a pro! Get out there and connect with folks in the industry, especially those who work with Azure Databricks. Attend meetups, webinars, or even just grab a coffee with someone in your target company. You never know who might help you land that dream job!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects related to Azure Data Services and Databricks. This could be anything from GitHub repos to case studies. When you can demonstrate your expertise, it makes you stand out in interviews.
✨Tip Number 3
Prepare for the technical grill! Brush up on your Python, PySpark, and SQL skills. Be ready to tackle some hands-on challenges during interviews. Practising common data engineering problems will give you the confidence to ace those technical assessments.
✨Tip Number 4
Don’t forget to apply through our website! We’ve got loads of opportunities waiting for talented engineers like you. Plus, applying directly shows your enthusiasm and commitment to joining our team. Let’s get you on board!
We think you need these skills to ace Azure Databricks Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV speaks directly to the job description. Highlight your experience with Azure Data Services and Databricks, and don’t forget to mention any relevant projects that showcase your skills in cloud data architecture.
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re the perfect fit for the Lead Azure Databricks Engineer role. Share specific examples of how you've tackled complex technical challenges and delivered high-quality outcomes.
Showcase Your Technical Skills:Don’t just list your skills; demonstrate them! Include details about your hands-on experience with Python, PySpark, and CI/CD processes. We want to see how you’ve applied these skills in real-world scenarios.
Apply Through Our Website:We encourage you to apply through our website for a smoother application process. It’s the best way for us to receive your application and ensure it gets the attention it deserves!
How to prepare for a job interview at Lloyd's
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure Data Services, Databricks, and all the other tools mentioned in the job description. Brush up on your knowledge of Delta Lake, PySpark, and CI/CD processes. Being able to discuss these technologies confidently will show that you’re the right fit for the role.
✨Understand the Business Context
Familiarise yourself with the Lloyd's of London market and its regulatory requirements. This will help you translate complex business needs into scalable cloud data architectures during the interview. Showing that you understand the industry will set you apart from other candidates.
✨Prepare for Technical Challenges
Expect to face some technical challenges during the interview. Practice solving problems related to data engineering and optimisation. Be ready to demonstrate your thought process and how you approach complex issues, as this is crucial for a hands-on engineering position.
✨Showcase Your Leadership Skills
Since this role involves providing hands-on technical leadership, be prepared to discuss your experience mentoring others and driving best practices. Share examples of how you've uplifted engineering capabilities in previous roles, as this will highlight your ability to lead and inspire a team.
