Databricks Consultant in London

Databricks Consultant in London

London Full-Time 60000 - 80000 £ / year (est.) No working from home possible
S

At a Glance

  • Tasks: Build and optimise data pipelines using Databricks and collaborate with trading teams.
  • Company: Join a leading firm in the energy trading sector with a focus on innovation.
  • Benefits: Competitive contract rates, flexible working arrangements, and opportunities for professional growth.
  • Other info: Inclusive workplace that values diversity and promotes equal opportunities.
  • Why this job: Make an impact in the energy market while working with cutting-edge technology.
  • Qualifications: Experience in energy trading and proficiency in Databricks and related technologies.

The predicted salary is between 60000 - 80000 £ per year.

Type: Contract

Location: London, England, UK

Key Responsibilities

  • Data Architecture: Build and optimize ETL/ELT pipelines using Databricks, Spark (PySpark/Scala), and Delta Lake for structured/unstructured energy market data.
  • Trading Analytics: Partner with Quants, Risk Managers, and Traders to implement models, curve generation, position tracking, and risk metrics (e.g., VaR).
  • Performance Optimization: Tune clusters and SQL warehouses for low-latency, time-sensitive trading environments.
  • Data Governance: Enforce governance, access controls, and compliance with UK/EU financial and energy regulations via Unity Catalog.
  • Consultative Leadership: Provide architectural best practices, mentor engineers, and advise stakeholders on maximizing Databricks ROI.

Required Skills & Experience

  • Energy Trading Expertise: Proven background in energy trading firms, banks, utilities, or oil/gas majors. Strong knowledge of physical/financial markets (Power, Gas, LNG, Crude, Carbon/Renewables) and trading data types (Reuters, Bloomberg, Trayport, weather, ETRM).
  • Databricks Mastery: Hands-on experience with production workloads on Databricks (Azure/AWS), PySpark, Spark SQL, Delta Lake, Unity Catalog, Python, SQL, orchestration tools (Airflow, Workflows, ADF), and streaming (Kafka/Event Hubs).
  • Professional Skills: Strong consultative mindset, excellent communication, and ability to interface with traders and senior stakeholders.

Databricks Consultant in London employer: Straive

Straive is an exceptional employer, offering a dynamic work environment in the heart of London where innovation meets inclusivity. As a Databricks Consultant, you will benefit from a culture that prioritises professional growth, mentorship, and collaboration with industry experts, while also enjoying competitive compensation and a commitment to diversity. Join us to make a meaningful impact in the energy trading sector, leveraging cutting-edge technology and best practices.

S

Contact Details:

Straive Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Databricks Consultant in London

Network Like a Pro

Get out there and connect with folks in the energy trading and Databricks space. Attend meetups, webinars, or industry events. You never know who might have the inside scoop on job openings!

Show Off Your Skills

When you land that interview, be ready to showcase your Databricks mastery. Bring examples of your ETL/ELT pipelines or any performance optimisation you've done. Real-world examples can really impress potential employers.

Ask Smart Questions

During interviews, don’t just answer questions—ask them too! Inquire about their data governance practices or how they handle compliance with UK/EU regulations. This shows you're genuinely interested and knowledgeable.

Apply Through Us!

Don’t forget to check our website for the latest job openings. Applying through us not only gives you access to exclusive roles but also helps us match you with the right opportunities based on your skills and experience.

We think you need these skills to ace Databricks Consultant in London

Data Architecture
ETL/ELT Pipelines
Databricks
Spark (PySpark/Scala)
Delta Lake
Trading Analytics
Risk Metrics (e.g., VaR)

Some tips for your application 🫡

Tailor Your CV:Make sure your CV highlights your experience with Databricks, Spark, and energy trading. We want to see how your skills match the job description, so don’t be shy about showcasing relevant projects!

Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about the role and how your background in energy trading makes you a perfect fit for us. Keep it engaging and personal!

Showcase Your Technical Skills:When listing your technical skills, be specific! Mention your hands-on experience with tools like PySpark, Delta Lake, and orchestration tools. We love seeing concrete examples of how you've used these in real-world scenarios.

Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it’s super easy!

How to prepare for a job interview at Straive

Know Your Databricks Inside Out

Make sure you brush up on your Databricks skills before the interview. Be ready to discuss your hands-on experience with ETL/ELT pipelines, PySpark, and Delta Lake. Prepare examples of how you've optimised performance in previous roles, as this will show your practical knowledge.

Understand the Energy Market

Since the role requires energy trading expertise, do your homework on the physical and financial markets relevant to the position. Familiarise yourself with trading data types and be prepared to discuss how your background aligns with the company's needs in this sector.

Showcase Your Consultative Skills

This role involves a lot of interaction with Quants, Risk Managers, and Traders. Be ready to demonstrate your consultative mindset and communication skills. Think of specific instances where you've successfully advised stakeholders or mentored engineers, as these experiences will highlight your leadership capabilities.

Prepare for Technical Questions

Expect technical questions related to performance optimisation and data governance. Brush up on tuning clusters and SQL warehouses, and be ready to discuss compliance with UK/EU regulations. Practising these topics will help you feel more confident during the interview.