At a Glance
- Tasks: Lead the design and optimisation of cloud data platforms using Azure technologies.
- Company: Join a leading firm in the Lloyd's of London market with a focus on innovation.
- Benefits: Enjoy a hybrid work model, competitive salary, and opportunities for professional growth.
- Other info: Collaborate with diverse teams and drive continuous improvement in data engineering.
- Why this job: Shape the future of cloud data strategy and make a real impact in a dynamic environment.
- Qualifications: Expertise in Azure Data Services, strong Python skills, and experience in regulated environments.
The predicted salary is between 80000 - 100000 £ per year.
Hybrid 2 days in London Office
We are seeking an outstanding Lead Azure Databricks Engineer to own the design, build, optimisation and governance of our enterprise cloud data platforms. This is a senior, fully hands-on engineering position requiring deep technical expertise, strong delivery capability and experience operating within the Lloyd's of London market and its regulatory demands. You will shape the future of our cloud data strategy, enabling advanced analytics and building secure, scalable and highly performant data solutions across the organisation.
Responsibilities
- Lead the development, optimisation and governance of large-scale data platforms using Azure Data Factory, Data Lake, Key Vault, Azure Functions, Databricks, Delta Lake, PySpark and Unity Catalog.
- Partner closely with underwriting, actuarial, delegated authority, bordereaux, exposure management, reinsurance, finance, Solvency II and risk teams to deliver solutions aligned to Lloyd's of London regulatory and operational requirements.
- Translate complex business needs into scalable cloud data architectures in partnership with architects, SMEs and product owners.
- Resolve complex technical challenges rapidly and decisively, consistently delivering high-quality outcomes.
- Champion engineering best practices including design patterns, data lifecycle management, CI/CD automation and cloud-native methodologies.
- Provide hands-on technical leadership, mentorship and uplift engineering capability across the team.
- Drive continuous improvement across performance, cost optimisation, reliability and resilience.
- Oversee end-to-end data engineering delivery ensuring quality, observability, robustness and compliance.
Qualifications
- Expert-level knowledge of Azure Data Services and Databricks within enterprise environments.
- Deep understanding of Delta Lake, Medallion architecture, distributed compute, Lakehouse patterns, data modelling and performance optimisation.
- Strong Python, PySpark and SQL experience, with hands-on implementation of CI/CD for data solutions using Azure DevOps.
- Strong understanding of data governance, lineage, access management, FinOps and secure cloud engineering.
- Excellent communication skills with the ability to confidently engage senior stakeholders and simplify complex technical concepts.
- Proven ability to take ownership, deliver at pace and operate effectively in high-pressure, high-expectation environments.
- Experience working within or delivering solutions for the Lloyd's of London market or similarly regulated environments.
Azure Databricks Engineer in City of Westminster employer: Lloyd's
As a Lead Azure Databricks Engineer, you will thrive in a dynamic and innovative environment that champions engineering excellence and continuous improvement. Our hybrid work model allows for flexibility while being based in the heart of London, providing access to a vibrant professional network and opportunities for collaboration with industry leaders. We prioritise employee growth through mentorship and hands-on leadership, ensuring you can shape your career while contributing to cutting-edge cloud data strategies within the Lloyd's of London market.
StudySmarter Expert Advice🤫
We think this is how you could land Azure Databricks Engineer in City of Westminster
✨Tip Number 1
Network like a pro! Reach out to folks in your industry on LinkedIn or at events. A friendly chat can lead to opportunities that aren’t even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio or GitHub repo showcasing your Azure Databricks projects. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by practising common technical questions related to Azure Data Services and Databricks. We recommend doing mock interviews with friends or using online platforms to boost your confidence.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Azure Databricks Engineer in City of Westminster
Some tips for your application 🫡
Tailor Your CV:Make sure your CV speaks directly to the job description. Highlight your experience with Azure Data Services, Databricks, and any relevant projects that showcase your skills in cloud data platforms. We want to see how you can fit into our team!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for the Lead Azure Databricks Engineer role. Share specific examples of how you've tackled complex technical challenges and delivered high-quality outcomes in previous roles.
Showcase Your Technical Skills:Don’t hold back on your technical expertise! Make sure to detail your experience with Python, PySpark, and CI/CD processes. We’re looking for someone who can hit the ground running, so let us know how you’ve applied these skills in real-world scenarios.
Apply Through Our Website:We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any important updates. Plus, it’s super easy!
How to prepare for a job interview at Lloyd's
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure Data Services, Databricks, and all the other tools mentioned in the job description. Brush up on your knowledge of Delta Lake, PySpark, and CI/CD processes. Being able to discuss these technologies confidently will show that you’re the right fit for the role.
✨Understand the Lloyd's Market
Familiarise yourself with the Lloyd's of London market and its regulatory requirements. This will not only help you answer questions more effectively but also demonstrate your commitment to understanding the environment you'll be working in. It’s a great way to connect your technical skills with the business needs.
✨Prepare Real-World Examples
Think of specific projects where you’ve led the development or optimisation of data platforms. Be ready to discuss challenges you faced, how you resolved them, and the impact of your solutions. This will showcase your hands-on experience and problem-solving abilities.
✨Engage with Stakeholders
Practice explaining complex technical concepts in simple terms. You’ll likely need to communicate with various teams, so being able to engage senior stakeholders effectively is key. Show that you can bridge the gap between technical and non-technical audiences.
