Databricks Consultant in London

Databricks Consultant in London

London Temporary 63000 - 77000 £ / year (est.) Home office (partial)
Trust In SODA

At a Glance

  • Tasks: Design and optimise trading data platforms using Databricks for real-time analytics.
  • Company: Leading firm in Energy & Commodities Trading with a hybrid work culture.
  • Benefits: Competitive market rate, flexible working, and opportunities for professional growth.
  • Other info: Collaborative environment with mentorship opportunities and career advancement.
  • Why this job: Join a dynamic team and make impactful decisions in the energy trading sector.
  • Qualifications: Experience in energy trading and expertise in Databricks and data architecture.

The predicted salary is between 63000 - 77000 £ per year.

  • Role Title: Databricks Consultant
  • Location: London, Hybrid
  • Duration: Initial 3 months
  • Rate: Market Related
  • Engagement: Outside IR35

We are seeking a seasoned Databricks Consultant with deep expertise in Energy & Commodities Trading to design, accelerate, and optimize our trading data platform.

Acting as the bridge between trading desks, quants, and engineering teams, you will leverage the Databricks Lakehouse to deliver scalable, real-time pipelines powering trading decisions, risk management, and market analytics.

Key Responsibilities

Data Architecture: Build and optimize ETL/ELT pipelines using Databricks, Spark (Py Spark/Scala), and Delta Lake for structured/unstructured energy market data.

Trading Analytics: Partner with Quants, Risk Managers, and Traders to implement models, curve generation, position tracking, and risk metrics (e. g., Va R).

Performance Optimization: Tune clusters and SQL warehouses for low-latency, time-sensitive trading environments.

Data Governance: Enforce governance, access controls, and compliance with UK/EU financial and energy regulations via Unity Catalog.

Consultative Leadership: Provide architectural best practices, mentor engineers, and advise stakeholders on maximizing Databricks ROI.

  • Required Skills & Experience
  • Energy
  • Trading

Expertise: Proven background in energy trading firms, banks, utilities, or oil/gas majors.

Strong knowledge of physical/financial markets (Power, Gas, LNG, Crude, Carbon/Renewables) and trading data types (Reuters, Bloomberg, Trayport, weather, ETRM).

  • Databricks

Mastery: Hands-on experience with production workloads on Databricks (Azure/AWS), Py Spark, Spark SQL, Delta Lake, Unity Catalog, Python, SQL, orchestration tools (Airflow, Workflows, ADF), and streaming (Kafka/Event Hubs).

  • Professional Skills: Strong consultative mindset, excellent communication, and ability to interface with traders and senior stakeholders.
  • #J-18808-Ljbffr

Databricks Consultant in London employer: Trust In SODA

Trust In SODA is an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration within one of Europe's largest Kubernetes projects. Employees benefit from extensive growth opportunities, including AWS and CKA certification, while enjoying the flexibility of a hybrid working environment that promotes work-life balance and personal development.

Trust In SODA

Contact Details:

Trust In SODA Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Databricks Consultant in London

Tap into Online Data Science Communities

Join online communities focused on data science like Kaggle, LinkedIn groups, or Reddit threads. These are goldmines for temporary gigs, as you can network with professionals and potentially hear about opportunities at companies like Trust In SODA before they're even advertised!

Show Off Your Skills With Projects

Got some cool data science projects? Showcase them on platforms like GitHub or create a personal portfolio website. This visibility is crucial for landing temporary roles—let recruiters see your actual skills in action, which can set you apart from the crowd.

Check Out Specialist Job Boards

For temp roles, hit up job boards dedicated to tech and data science, like Stack Overflow Jobs or DataJobs. These platforms often feature openings that you won’t find on general job sites, including contracts with companies like Trust In SODA.

Leverage University Resources

If you're currently at uni or recently graduated, tap into your school's career services. They often have connections with companies looking for temporary data science interns or contract workers, and they might even host job fairs with employers like Trust In SODA.

We think you need these skills to ace Databricks Consultant in London

Databricks
Energy Trading Expertise
ETL/ELT Pipelines
Spark (PySpark/Scala)
Delta Lake
Trading Analytics
Performance Optimization

Some tips for your application 🫡

Highlight Your Data Projects:When applying for a temporary data science role at Trust In SODA, make sure to showcase any relevant projects you've worked on. Whether it's a personal project, an academic undertaking, or contributions to an open-source initiative, detailing these experiences can really set you apart and demonstrate your practical skills.

Emphasise Your Analytical Skills:In your CV and cover letter, focus on the specific analytical skills that are key to data science. Mention any experience with statistical tools, programming languages like Python or R, and data visualisation software. Don't forget to include any certifications that may bolster your expertise!

Show Your Flexibility:Since this is a temporary role, it's important to convey your adaptability and willingness to learn. In your cover letter to Trust In SODA, emphasise how quickly you can get up to speed with new tools or projects. Highlight any previous experiences where you've had to adjust to new environments or challenges.

Craft a Unique Data-Driven Cover Letter:Instead of the usual generic cover letter, spice it up with some data! Maybe you’ve improved a process by 20% in a past role or cleaned a dataset with over a million entries. Use these stats to your advantage to grab Trust In SODA’s attention and show the tangible impact of your work.

How to prepare for a job interview at Trust In SODA

Showcase Your Analytical Skills

For a data science gig, it's crucial to demonstrate your analytical abilities. Be ready to discuss previous projects and the methodologies you used. Think about how you can quantify your impact—did your analysis improve efficiency or save costs? These are the stories that will stick with interviewers at Trust In SODA.

Brush Up on Technical Skills

You might face technical questions on tools relevant to data science, like Python, R, or SQL. Prepare to solve a problem live—perhaps they'll ask you to write a simple query or code snippet. It’s cool to talk about them, but we need to show we can do it in practice, especially in a temporary role where quick results matter.

Highlight Your Adaptability

Since this is a temporary position, emphasise your ability to learn quickly and adapt to new tools or workflows. Share examples of how you've thrived in fast-paced environments before, and how you can hit the ground running at Trust In SODA.

Prepare a Portfolio of Your Work

Bring your portfolio to the table—showcase projects where you've leveraged data science techniques to solve problems. Whether it’s a GitHub repository or a set of case studies, having tangible examples of your work will help you stand out and show what you bring to the team at Trust In SODA.