Lead Databricks Engineer in London

Lead Databricks Engineer in London

London Temporary 72000 - 88000 £ / year (est.) Hybrid
S

At a Glance

  • Tasks: Lead data engineering projects using Databricks, Spark, Python, and SQL.
  • Company: Innovative tech company focused on AI-ready data solutions.
  • Benefits: Competitive salary, flexible working hours, and opportunities for professional growth.
  • Other info: Dynamic work environment with a focus on collaboration and innovation.
  • Why this job: Shape the future of data engineering and lead a talented team.
  • Qualifications: 7+ years in data engineering with leadership experience and strong technical skills.

The predicted salary is between 72000 - 88000 £ per year.

We want a technically strong engineer with a clear view of how data engineering should be done, and the leadership to bring people with them. You set the standard for quality, design and data modelling, and you earn and keep the trust of engineers, external partners and the business.

You are:

  • Technically strong: You are hands-on and credible with Databricks, Spark, Python and SQL. You can solve the hardest problems yourself and review others' work with authority.
  • Someone with a strong engineering vision: You have firm, well-reasoned opinions on how things should be built, and you turn them into standards, templates and patterns that others follow.
  • Focused on quality, design and modelling: You care about doing things properly. You believe good data modelling is the foundation of trusted data products, and you design before you build.
  • A leader people trust: You talk to engineers, external partners and business stakeholders with equal ease. You build trust quickly, keep it, and use it to guide decisions and raise the team's level.
  • A builder of foundations: You would rather build a reusable template once than solve the same problem ten times. You make data AI-ready and secure by design, not as an afterthought.

Our platform is built on Databricks. We are moving our data products into a new, governed workspace designed to be AI-ready. We make them usable through AI data agents such as Databricks Genie, and we support a growing community of technical analysts and analytics engineers in the business who build on the platform themselves. Engineers work in small delivery teams with a Scrum Master and deliver in increments, building, demonstrating and iterating with business stakeholders.

What you will bring:

  • Essential: 7+ years in data engineering, including at least 2 years leading or mentoring engineers.
  • Deep hands-on experience with Databricks and Spark (Unity Catalog, Delta Lake, Lakeflow / DLT), advanced Python and SQL.
  • Excellent data modelling skills and experience building data as a product.
  • A track record of building reusable templates, shared libraries and CI/CD that other engineers adopt.
  • Software engineering discipline applied to data: versioning, testing, pipelines as code.
  • Working knowledge of AI data agents (e.g. Databricks Genie) and what makes data AI-ready.
  • Clear, persuasive communication with technical and non-technical people.

Nice to have:

  • AI agent architecture (LLM agents, RAG, MCP) or experience operationalising ML models.
  • Azure data services alongside Databricks, dbt, and data contracts (ODPS, ODCS).
  • FinOps on Databricks, Scrum delivery, and leading hybrid teams across the UK and continental Europe.

Lead Databricks Engineer in London employer: Sentior, Ltd.

At Sentior, Ltd., we pride ourselves on fostering a collaborative and innovative work culture that empowers our employees to excel in their roles. As a Manufacturing Engineer, you will benefit from extensive professional development opportunities, competitive compensation, and a supportive environment that values continuous improvement and teamwork. Located in the heart of the United Kingdom, our facilities are equipped with cutting-edge technology, providing you with the tools needed to make a meaningful impact in the manufacturing sector.

S

Contact Details:

Sentior, Ltd. Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Lead Databricks Engineer in London

✨Tap into Online Data Science Communities

Join online communities focused on data science like Kaggle, LinkedIn groups, or Reddit threads. These are goldmines for temporary gigs, as you can network with professionals and potentially hear about opportunities at companies like Sentior, Ltd. before they're even advertised!

✨Show Off Your Skills With Projects

Got some cool data science projects? Showcase them on platforms like GitHub or create a personal portfolio website. This visibility is crucial for landing temporary roles—let recruiters see your actual skills in action, which can set you apart from the crowd.

✨Check Out Specialist Job Boards

For temp roles, hit up job boards dedicated to tech and data science, like Stack Overflow Jobs or DataJobs. These platforms often feature openings that you won’t find on general job sites, including contracts with companies like Sentior, Ltd..

✨Leverage University Resources

If you're currently at uni or recently graduated, tap into your school's career services. They often have connections with companies looking for temporary data science interns or contract workers, and they might even host job fairs with employers like Sentior, Ltd..

We think you need these skills to ace Lead Databricks Engineer in London

Databricks
Spark
Python
SQL
Data Modelling
Leadership
Template Building

Some tips for your application 🫡

Highlight Your Data Projects:When applying for a temporary data science role at Sentior, Ltd., make sure to showcase any relevant projects you've worked on. Whether it's a personal project, an academic undertaking, or contributions to an open-source initiative, detailing these experiences can really set you apart and demonstrate your practical skills.

Emphasise Your Analytical Skills:In your CV and cover letter, focus on the specific analytical skills that are key to data science. Mention any experience with statistical tools, programming languages like Python or R, and data visualisation software. Don't forget to include any certifications that may bolster your expertise!

Show Your Flexibility:Since this is a temporary role, it's important to convey your adaptability and willingness to learn. In your cover letter to Sentior, Ltd., emphasise how quickly you can get up to speed with new tools or projects. Highlight any previous experiences where you've had to adjust to new environments or challenges.

Craft a Unique Data-Driven Cover Letter:Instead of the usual generic cover letter, spice it up with some data! Maybe you’ve improved a process by 20% in a past role or cleaned a dataset with over a million entries. Use these stats to your advantage to grab Sentior, Ltd.’s attention and show the tangible impact of your work.

How to prepare for a job interview at Sentior, Ltd.

✨Showcase Your Analytical Skills

For a data science gig, it's crucial to demonstrate your analytical abilities. Be ready to discuss previous projects and the methodologies you used. Think about how you can quantify your impact—did your analysis improve efficiency or save costs? These are the stories that will stick with interviewers at Sentior, Ltd..

✨Brush Up on Technical Skills

You might face technical questions on tools relevant to data science, like Python, R, or SQL. Prepare to solve a problem live—perhaps they'll ask you to write a simple query or code snippet. It’s cool to talk about them, but we need to show we can do it in practice, especially in a temporary role where quick results matter.

✨Highlight Your Adaptability

Since this is a temporary position, emphasise your ability to learn quickly and adapt to new tools or workflows. Share examples of how you've thrived in fast-paced environments before, and how you can hit the ground running at Sentior, Ltd..

✨Prepare a Portfolio of Your Work

Bring your portfolio to the table—showcase projects where you've leveraged data science techniques to solve problems. Whether it’s a GitHub repository or a set of case studies, having tangible examples of your work will help you stand out and show what you bring to the team at Sentior, Ltd..