Databricks Technical Lead (Azure) | Commodity Trading | Greenfield Data Platform | Up to £1,000[...]
Databricks Technical Lead (Azure) | Commodity Trading | Greenfield Data Platform | Up to £1,000[...]

Databricks Technical Lead (Azure) | Commodity Trading | Greenfield Data Platform | Up to £1,000[...]

Freelance 80000 - 120000 £ / year (est.) Home office (partial)
V

At a Glance

  • Tasks: Lead the design and implementation of a cutting-edge Databricks platform on Azure.
  • Company: Join a large, innovative commodity trading organisation with a focus on data.
  • Benefits: Competitive daily rate, hybrid working, and opportunities for professional growth.
  • Why this job: Be at the forefront of a greenfield project and shape the future of data analytics.
  • Qualifications: Strong experience in Databricks, Azure, Python, and SQL required.
  • Other info: Dynamic role with a focus on technical leadership and mentorship.

The predicted salary is between 80000 - 120000 £ per year.

A Databricks Technical Lead is required for a large, complex commodity trading organisation undertaking a greenfield implementation of Databricks on Azure. This is a strategic data platform programme, focused on building a modern, scalable lakehouse architecture to support analytics, reporting, and downstream data use cases. This Databricks Technical Lead role will take end-to-end technical ownership of the Databricks platform, leading design decisions, setting engineering standards, and guiding delivery across a hybrid on-prem and Azure environment. You will act as the senior technical authority, working closely with data engineers, architects, platform teams, and senior stakeholders to ensure the platform is built correctly from day one.

Key Responsibilities of the Databricks Technical Lead:

  • Lead the greenfield design and implementation of Databricks on Azure.
  • Define and own platform architecture, patterns, and best practices.
  • Design and oversee development of scalable data pipelines using Spark, Python, and SQL.
  • Lead ingestion from on-prem data sources into Azure and Databricks.
  • Drive adoption of lakehouse architecture, data modelling standards, and performance optimisation.
  • Act as the technical escalation point for Databricks, Spark, and Azure data services.
  • Provide technical leadership and mentorship to data engineers.
  • Conduct design reviews and ensure high engineering quality.
  • Work with security and platform teams on governance, access control, and compliance.
  • Support early POCs, MVPs, and longer-term platform evolution.

Hybrid working: 2–3 days per week, City of London

Essential Skills & Experience for the Databricks Technical Lead:

  • Proven experience as a Databricks Technical Lead or Senior Data Engineer / Architect.
  • Strong hands-on Databricks experience on Azure.
  • Experience leading greenfield data platform implementations.
  • Strong Python and SQL skills for data engineering.
  • Experience integrating on-prem systems with Azure.
  • Experience defining engineering standards and architecture.
  • Strong stakeholder communication and leadership skills.

Domain experience (e.g. energy, commodities, finance) is NOT required — this role is focused on technical delivery and platform leadership.

Databricks Technical Lead (Azure) | Commodity Trading | Greenfield Data Platform | Up to £1,000[...] employer: VirtueTech Recruitment Group

Join a leading commodity trading organisation that champions innovation and technical excellence in the heart of London. As a Databricks Technical Lead, you will thrive in a dynamic hybrid work environment, benefiting from a culture that prioritises collaboration, professional growth, and cutting-edge technology. With opportunities for mentorship and leadership, this role offers a unique chance to shape a greenfield data platform while enjoying competitive compensation and a supportive team atmosphere.
V

Contact Detail:

VirtueTech Recruitment Group Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Databricks Technical Lead (Azure) | Commodity Trading | Greenfield Data Platform | Up to £1,000[...]

Tip Number 1

Network like a pro! Reach out to your connections in the industry, attend meetups, and engage on platforms like LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.

Tip Number 2

Prepare for those interviews! Research the company and its tech stack, especially around Databricks and Azure. Practise common technical questions and be ready to showcase your problem-solving skills with real-world examples.

Tip Number 3

Show off your projects! If you've worked on relevant data platforms or have personal projects that highlight your skills, make sure to discuss them during interviews. This is your chance to demonstrate your hands-on experience.

Tip Number 4

Apply through our website! We’ve got loads of opportunities, and applying directly can sometimes give you an edge. Plus, it’s super easy to keep track of your applications and updates.

We think you need these skills to ace Databricks Technical Lead (Azure) | Commodity Trading | Greenfield Data Platform | Up to £1,000[...]

Databricks
Azure
Data Engineering
Spark
Python
SQL
Data Pipeline Development
Lakehouse Architecture
Performance Optimisation
Technical Leadership
Stakeholder Communication
Engineering Standards Definition
Mentorship

Some tips for your application 🫡

Tailor Your CV: Make sure your CV highlights your experience with Databricks and Azure. We want to see how your skills align with the role, so don’t be shy about showcasing relevant projects or achievements!

Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you’re the perfect fit for the Databricks Technical Lead position. We love seeing your passion for data platforms and how you can contribute to our greenfield project.

Showcase Your Leadership Skills: Since this role involves leading teams and making design decisions, make sure to highlight any previous leadership experiences. We want to know how you’ve guided others and driven successful outcomes in past projects.

Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you don’t miss out on any important updates from our team!

How to prepare for a job interview at VirtueTech Recruitment Group

Know Your Databricks Inside Out

Make sure you brush up on your Databricks knowledge, especially in the context of Azure. Be ready to discuss your hands-on experience and any greenfield implementations you've led. This will show that you’re not just familiar with the platform but can also lead its design and implementation.

Showcase Your Technical Leadership

Prepare examples of how you've provided technical leadership in past roles. Think about times when you’ve guided teams through complex projects or made critical design decisions. This will demonstrate your capability as a senior technical authority.

Communicate Clearly with Stakeholders

Since this role involves working closely with various stakeholders, practice articulating your thoughts clearly. Be ready to explain technical concepts in a way that non-technical stakeholders can understand. This will highlight your strong communication skills.

Prepare for Design Reviews

Anticipate questions around design reviews and engineering standards. Think about how you would approach these discussions and be prepared to defend your design choices. This will show that you have a solid grasp of high engineering quality and best practices.

Databricks Technical Lead (Azure) | Commodity Trading | Greenfield Data Platform | Up to £1,000[...]
VirtueTech Recruitment Group

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

V
Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>