Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the transformation of financial data into accessible formats using Databricks and Delta Lake.
- Company: Join BMLL, a leading provider of market data analytics with a collaborative culture.
- Benefits: Enjoy hybrid working, team lunches, and social activities in a supportive environment.
- Why this job: Make a real impact on data architecture and help shape the future of financial analytics.
- Qualifications: Experience with Databricks, Delta Lake, and strong problem-solving skills required.
- Other info: Dynamic role with opportunities for professional growth in a fast-paced industry.
The predicted salary is between 60000 - 80000 £ per year.
About BMLL
BMLL is the leading independent provider of harmonised Level 3, 2 and 1 historical data and analytics across global equities, ETFs, futures and US equity options. We provide market participants with immediate access to granular T+1 order book data and advanced analytics, enabling them to accelerate research, optimise trading strategies, and better understand market behaviour. BMLL was acquired in 2025 by Nordic Capital, alongside minority shareholder Optiver, marking a joint commitment to accelerate the company's next phase of growth. We offer an inclusive and collaborative culture, a hybrid working environment that includes regular days in our London office, weekly team lunches, and a variety of out-of-hours social activities.
About the Role
BMLL transforms financial exchanges' raw market data into an accessible and normalised view for customers across multiple use-cases. We hold over 10 years of full-depth market data across approximately 100 venues, this currently consists of about 1.5 billion HDF5 files (1.5 PB) stored on S3 and catalogued in Postgres. These are partitioned by date, venue, and instrument. While this structure has served us well, the enormous number of small files, with the Postgres catalogue in separate storage, is now the main constraint on how we evolve, back-up/recover, and share data. Our strategic direction is to migrate this processed layer to Delta Lake for both data and catalogue. In addition we are migrating our Data Products which currently sit in Snowflake over to Iceberg compatible Delta Tables in order to leverage benefits of performance, cost and manageability.
We are looking for an experienced Databricks Lead Engineer and Architect to join and support the Delta Lake and Delta Table re-engineering projects. This is a hands-on role and with direct contribution to the project. The goal is not merely format migration, but addressing key architectural objectives for high-cardinality data:
- Implement a Delta Lake architecture for large scale data.
- Model and partition L2/L3 order book data in Delta lake.
- Implement metadata, compaction, and versioning.
- Design a system that supports multiple delivery models downstream.
- Implement a viable backup strategy at this scale with a 1-day RTO.
Requirements
ESSENTIAL
- Industry experience with Databricks
- Delta Lake
- Unity Catalog
- Delta Tables
- Delta UniForm (Universal Format)
- Industry experience with Apache iceberg
- AWS, S3
- Tables, Lake formation
- Industry experience in developing on a Linux platform
- Experience with industry-standard development methodologies such as source code control, unit testing and continuous integration
- A self-starter with the ability to self-organise
- Strong problem-solving skills
- Strong communication skills
DESIRABLE
- Industry experience with Snowflake
- Industry experience with petabyte scale data volumes
- Industry experience with Python
- Experience working with financial data
Databricks Lead Engineer (Contract) in London employer: BMLL
Contact Detail:
BMLL Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Databricks Lead Engineer (Contract) in London
✨Tip Number 1
Network like a pro! Reach out to folks in your industry on LinkedIn or at meetups. We all know that sometimes it’s not just what you know, but who you know that can land you that Databricks Lead Engineer gig.
✨Tip Number 2
Show off your skills! If you’ve got a portfolio or GitHub with projects related to Delta Lake or Databricks, make sure to highlight them. We want to see your hands-on experience and how you tackle real-world problems.
✨Tip Number 3
Prepare for the interview by brushing up on your problem-solving skills. Expect technical questions that dive deep into your experience with large-scale data and architecture. We’re looking for someone who can think on their feet!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we love seeing candidates who take the initiative to connect directly with us.
We think you need these skills to ace Databricks Lead Engineer (Contract) in London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Databricks Lead Engineer role. Highlight your experience with Delta Lake, Databricks, and any relevant projects you've worked on. We want to see how your skills align with what we're looking for!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about this role and how your background makes you a perfect fit. Don’t forget to mention your experience with large-scale data and problem-solving skills.
Showcase Your Projects: If you've worked on any relevant projects, make sure to include them in your application. We love seeing real-world examples of your work, especially if they involve Delta Lake or similar technologies. It helps us understand your hands-on experience!
Apply Through Our Website: We encourage you to apply through our website for the best chance of getting noticed. It’s super easy, and you’ll be able to keep track of your application status. Plus, we love seeing applications come directly from our site!
How to prepare for a job interview at BMLL
✨Know Your Databricks Inside Out
Make sure you brush up on your Databricks knowledge before the interview. Understand how Delta Lake works, and be ready to discuss your experience with it. They’ll want to hear about specific projects where you’ve implemented Delta Tables or Unity Catalog, so have some examples ready.
✨Showcase Your Problem-Solving Skills
Prepare to discuss challenges you've faced in previous roles, especially related to high-cardinality data or large-scale migrations. Think of a couple of scenarios where you successfully solved complex problems, as this will demonstrate your analytical skills and ability to think on your feet.
✨Familiarise Yourself with Their Data Architecture
Dive into BMLL's current data architecture and understand their goals for migrating to Delta Lake. Being able to speak knowledgeably about their needs and how you can contribute to their projects will set you apart from other candidates.
✨Communicate Clearly and Confidently
Strong communication skills are essential for this role. Practice explaining technical concepts in simple terms, as you may need to convey complex ideas to non-technical stakeholders. Confidence in your communication will help you make a great impression.