At a Glance
- Tasks: Lead the design and optimisation of cloud data platforms using Azure technologies.
- Company: Join a leading firm in the Lloyd's of London market with a focus on innovation.
- Benefits: Enjoy a hybrid work model, competitive salary, and opportunities for professional growth.
- Other info: Collaborate with diverse teams and tackle complex challenges in a high-pressure setting.
- Why this job: Shape the future of cloud data strategy and make a real impact in a dynamic environment.
- Qualifications: Expertise in Azure Data Services, Databricks, and strong Python skills required.
The predicted salary is between 80000 - 100000 £ per year.
We are seeking an outstanding Lead Azure Databricks Engineer to own the design, build, optimisation and governance of our enterprise cloud data platforms. This is a senior, fully hands-on engineering position requiring deep technical expertise, strong delivery capability and experience operating within the Lloyd's of London market and its regulatory demands. You will shape the future of our cloud data strategy, enabling advanced analytics and building secure, scalable and highly performant data solutions across the organisation.
Responsibilities
- Lead the development, optimisation and governance of large-scale data platforms using Azure Data Factory, Data Lake, Key Vault, Azure Functions, Databricks, Delta Lake, PySpark and Unity Catalog.
- Partner closely with underwriting, actuarial, delegated authority, bordereaux, exposure management, reinsurance, finance, Solvency II and risk teams to deliver solutions aligned to Lloyd's of London regulatory and operational requirements.
- Translate complex business needs into scalable cloud data architectures in partnership with architects, SMEs and product owners.
- Resolve complex technical challenges rapidly and decisively, consistently delivering high-quality outcomes.
- Champion engineering best practices including design patterns, data lifecycle management, CI/CD automation and cloud-native methodologies.
- Provide hands-on technical leadership, mentorship and uplift engineering capability across the team.
- Drive continuous improvement across performance, cost optimisation, reliability and resilience.
- Oversee end-to-end data engineering delivery ensuring quality, observability, robustness and compliance.
Qualifications
- Expert-level knowledge of Azure Data Services and Databricks within enterprise environments.
- Deep understanding of Delta Lake, Medallion architecture, distributed compute, Lakehouse patterns, data modelling and performance optimisation.
- Strong Python, PySpark and SQL experience, with hands-on implementation of CI/CD for data solutions using Azure DevOps.
- Strong understanding of data governance, lineage, access management, FinOps and secure cloud engineering.
- Excellent communication skills with the ability to confidently engage senior stakeholders and simplify complex technical concepts.
- Proven ability to take ownership, deliver at pace and operate effectively in high-pressure, high-expectation environments.
- Experience working within or delivering solutions for the Lloyd's of London market or similarly regulated environments.
Azure Databricks Engineer in London employer: Lloyd's
As a Lead Azure Databricks Engineer at our company, you will thrive in a dynamic hybrid work environment that fosters innovation and collaboration. We offer competitive benefits, a strong commitment to employee development, and the opportunity to work at the heart of the Lloyd's of London market, where your expertise will directly influence our cloud data strategy. Join us to be part of a culture that values technical excellence and continuous improvement, ensuring you have the resources and support to grow your career while making a meaningful impact.
StudySmarter Expert Advice🤫
We think this is how you could land Azure Databricks Engineer in London
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, especially those who work with Azure Databricks. Attend meetups or webinars, and don’t be shy about asking for informational interviews. You never know who might have a lead on your dream job!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects with Azure Data Factory, Databricks, and other relevant tools. This can be a game-changer during interviews, as it gives potential employers a tangible sense of what you can do.
✨Tip Number 3
Prepare for technical interviews by brushing up on your Python, PySpark, and SQL skills. Practice common data engineering problems and be ready to discuss how you've tackled complex challenges in past roles. Confidence is key!
✨Tip Number 4
Don’t forget to apply through our website! We’re always on the lookout for talented individuals like you. Plus, it’s a great way to ensure your application gets the attention it deserves. Let’s get you that Azure Databricks Engineer role!
We think you need these skills to ace Azure Databricks Engineer in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV speaks directly to the job description. Highlight your experience with Azure Data Services, Databricks, and any relevant projects that showcase your skills in cloud data architecture. We want to see how you can fit into our team!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for the Lead Azure Databricks Engineer role. Share specific examples of how you've tackled complex technical challenges and delivered high-quality outcomes in previous roles.
Showcase Your Technical Skills:Don’t hold back on your technical expertise! Make sure to detail your experience with Python, PySpark, and CI/CD processes. We’re looking for someone who can hit the ground running, so let us know how you’ve applied these skills in real-world scenarios.
Apply Through Our Website:We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any important updates. Plus, it’s super easy!
How to prepare for a job interview at Lloyd's
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure Data Services, Databricks, and all the other tools mentioned in the job description. Brush up on your knowledge of Delta Lake, PySpark, and CI/CD processes. Being able to discuss these technologies confidently will show that you’re the right fit for the role.
✨Understand the Lloyd's Market
Familiarise yourself with the Lloyd's of London market and its regulatory requirements. This will not only help you answer questions more effectively but also demonstrate your commitment to understanding the environment you'll be working in. It’s a great way to connect your technical skills to real-world applications.
✨Prepare for Scenario-Based Questions
Expect to face scenario-based questions that assess your problem-solving skills. Think about past experiences where you’ve resolved complex technical challenges or optimised data platforms. Be ready to explain your thought process and the outcomes of your actions.
✨Showcase Your Communication Skills
Since the role involves engaging with senior stakeholders, practice simplifying complex technical concepts. Prepare examples of how you've communicated technical information to non-technical teams in the past. This will highlight your ability to bridge the gap between tech and business needs.
