Lead Data Engineer (Azure/Databricks)
Lead Data Engineer (Azure/Databricks)

Lead Data Engineer (Azure/Databricks)

London Full-Time 48000 - 84000 £ / year (est.) No home office possible
Go Premium
D

At a Glance

  • Tasks: Lead database modernisation and migration projects while optimising performance and ensuring data accuracy.
  • Company: Join a top consultancy known for impactful software and data engineering solutions across various sectors.
  • Benefits: Enjoy a hybrid work model, competitive salary, and the chance to work with cutting-edge technologies.
  • Why this job: Be part of a collaborative team that values care, quality, and leadership in delivering transformative solutions.
  • Qualifications: Must have extensive experience with Databricks, Azure, Python, and a background in regulated environments.
  • Other info: This is a contract role with opportunities for mentorship and technical leadership.

The predicted salary is between 48000 - 84000 £ per year.

Direct message the job poster from developrec

Head of Global Delivery Centre | Tech Recruitment Partner @ developrec

Job Type: Contract (Inside IR35)

Location: Hybrid – 2 days a week in London

Start Date: ASAP

A leading technology consultancy is looking for a highly skilled Lead Data Engineer with strong Databricks and Azure experience

This position offers the opportunity to work within a fast-paced, collaborative environment, delivering critical modernisation solutions for a high-profile client.

This is a pivotal role for an experienced professional passionate about data engineering and transformational delivery.

Key Responsibilities

  • Lead the planning and execution of database modernisation, conversion, and migration activities, ensuring alignment with project timelines and deliverables.
  • Oversee database architecture assessments and performance optimisation efforts.
  • Collaborate with development and architecture teams to improve data flow and streamline database operations.
  • Conduct thorough testing and validation of migrated data to ensure completeness and accuracy.
  • Develop and maintain comprehensive documentation of migration strategies, standards, and processes.
  • Provide mentorship and technical leadership to team members.
  • Extensive experience as an Lead Data Engineer
  • Strong Databricks, Azure and Python experience
  • Experience in a highly regulated environment
  • Must have production experience
  • Worked with modern data pipelines
  • Regulated environment experience is a must (ideally financial services)

About the Company

This consultancy is renowned for delivering high-risk, high-profile software and data engineering projects at pace. Their clients include leading organisations across commodities, energy trading, finance, digital, and public sectors.

The company is driven by a culture of Care, Quality, and Leadership, and is committed to delivering business value through technological excellence.

They pride themselves on working in close partnership with clients and users, utilising modern technologies and agile methodologies to bring about meaningful change. Their teams are built on mutual respect, continuous learning, and a shared passion for delivering impactful solutions.

The organisation has earned numerous industry awards for its innovative solutions and is actively expanding its team of forward-thinking professionals.

Seniority level

  • Seniority level

    Mid-Senior level

Employment type

  • Employment type

    Contract

Job function

  • Job function

    Information Technology

  • Industries

    Data Infrastructure and Analytics, Software Development, and Financial Services

Referrals increase your chances of interviewing at developrec by 2x

Sign in to set job alerts for “Data Engineer” roles.

London, England, United Kingdom 1 week ago

London Area, United Kingdom $150,000.00-$200,000.00 3 days ago

London, England, United Kingdom 6 days ago

London, England, United Kingdom 2 hours ago

City Of London, England, United Kingdom £35,000.00-£42,000.00 1 week ago

Greater London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 3 days ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 4 hours ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 2 weeks ago

Greater London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 2 weeks ago

Graduate Software Engineer 2025 – RegTech

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Lead Data Engineer (Azure/Databricks) employer: developrec

As a leading technology consultancy, we offer an exceptional work environment that fosters collaboration and innovation, particularly for our Lead Data Engineer role. Our hybrid model allows for flexibility while working on high-profile projects that drive meaningful change across various sectors. With a strong emphasis on employee growth, mentorship, and a culture rooted in Care, Quality, and Leadership, we are committed to empowering our team members to excel in their careers while delivering impactful solutions.
D

Contact Detail:

developrec Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Lead Data Engineer (Azure/Databricks)

Tip Number 1

Make sure to showcase your experience with Databricks and Azure in any conversations you have. Highlight specific projects where you've successfully implemented these technologies, as this will demonstrate your hands-on expertise.

Tip Number 2

Network with professionals in the financial services sector, as having regulated environment experience is crucial for this role. Attend industry meetups or webinars to connect with others who can provide insights or referrals.

Tip Number 3

Prepare to discuss your approach to database modernisation and migration strategies in detail. Be ready to explain how you ensure data accuracy and completeness during these processes, as this is a key responsibility of the role.

Tip Number 4

Consider reaching out directly to the job poster on LinkedIn. A personalised message expressing your interest and relevant experience can help you stand out and may lead to a more favourable impression.

We think you need these skills to ace Lead Data Engineer (Azure/Databricks)

Lead Data Engineering
Databricks
Azure
Python
Database Modernisation
Data Migration
Database Architecture Assessment
Performance Optimisation
Data Flow Improvement
Testing and Validation of Data
Documentation of Migration Strategies
Technical Leadership
Mentorship
Experience in Regulated Environments
Agile Methodologies

Some tips for your application 🫡

Tailor Your CV: Make sure your CV highlights your experience with Databricks, Azure, and Python. Emphasise any previous roles where you led database modernisation or worked in regulated environments, particularly in financial services.

Craft a Compelling Cover Letter: In your cover letter, express your passion for data engineering and transformational delivery. Mention specific projects where you've successfully implemented modern data pipelines and how your leadership has positively impacted team performance.

Showcase Relevant Experience: When detailing your work history, focus on your production experience and any high-profile projects you've been involved in. Use metrics to demonstrate the impact of your contributions, such as improvements in data flow or performance optimisation.

Prepare for Technical Questions: Anticipate technical questions related to database architecture, migration strategies, and performance optimisation. Be ready to discuss your problem-solving approach and provide examples from your past experiences that showcase your expertise.

How to prepare for a job interview at developrec

Showcase Your Technical Skills

Be prepared to discuss your experience with Databricks, Azure, and Python in detail. Highlight specific projects where you've successfully implemented these technologies, especially in regulated environments like financial services.

Demonstrate Leadership Experience

Since this role involves providing mentorship and technical leadership, share examples of how you've led teams or projects in the past. Discuss your approach to guiding less experienced team members and fostering a collaborative environment.

Prepare for Scenario-Based Questions

Expect questions that assess your problem-solving skills in real-world scenarios. Think about challenges you've faced during database modernisation or migration activities and how you overcame them, ensuring you align your answers with the company's focus on quality and care.

Understand the Company Culture

Research the consultancy's values and recent projects. Be ready to discuss how your personal values align with theirs, particularly around continuous learning and delivering impactful solutions. This will show your genuine interest in being part of their team.

Lead Data Engineer (Azure/Databricks)
developrec
Go Premium

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

D
  • Lead Data Engineer (Azure/Databricks)

    London
    Full-Time
    48000 - 84000 £ / year (est.)

    Application deadline: 2027-08-09

  • D

    developrec

Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>