Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...] in London
Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...]

Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...] in London

London Full-Time 100000 - 100000 £ / year (est.) No home office possible
VirtueTech Recruitment Group

At a Glance

  • Tasks: Design and optimise high-performance data clusters for energy trading analytics.
  • Company: Join a leading global Energy & Commodities trading house with diverse opportunities.
  • Benefits: Earn up to £100K plus bonuses and great benefits.
  • Why this job: Shape the future of data engineering in a cutting-edge, cloud-native environment.
  • Qualifications: Experience in data engineering and proficiency in ClickHouse or Azure Databricks.
  • Other info: Collaborate with a skilled team and enjoy excellent career growth in London.

The predicted salary is between 100000 - 100000 £ per year.

Senior Data Engineer is required for a leading global Energy & Commodities trading house — one of the world’s largest and most diverse general trading companies. Their trading ecosystem spans multiple commodities and markets, creating high-volume, high-velocity data challenges ideally suited to ClickHouse and modern data engineering.

As a Senior Data Engineer, you will play a pivotal role in choosing the right tooling, building and scaling a cloud-native AI-driven analytical data platform. You’ll be a senior member of the Core Engineering team, shaping the architecture and implementing high-performance data solutions used directly by trading, risk, analytics and operational teams.

Whilst the firm has agreed to do an Azure Databricks POC platform in Q1 2026, with so much of their data on-prem, they are still showcasing different Cloud-native platforms, and therefore are looking for someone who is excited to build Proof of Concepts in the right platform for the business requirements. This is a hands-on position where you’ll be working with a high-skilled small team of engineers while designing and developing a next-generation lakehouse architecture.

Azure Databricks & ClickHouse will form the backbone of examples of two systems, supporting ultra-fast analytics, market-data ingestion, tick-data storage, and real-time insights for traders and quantitative teams.

Salary: Up to £100,000 per annum + Bonus & Benefits

What You’ll Do

  • Design, build, and optimise high-performance ClickHouse / Azure Databricks / AI Cloud-native Data clusters for large-scale analytical workloads across commodities and energy trading.
  • Develop ingestion frameworks for market data, pricing data, tick data, and trade/position datasets, leveraging ClickHouse’s columnar storage and real-time querying.
  • Architect and maintain a modern lakehouse platform integrating ClickHouse with Databricks, Snowflake, and Azure-based services.
  • Define and enforce best practices for data modelling, partitioning, compression, and query optimisation tailored for ClickHouse.
  • Build scalable Python-based ETL/ELT pipelines and data services that deliver robust, low-latency data to trading, risk, and analytics teams.

If you are interested in this role, please send your CV to

Location: London, England, United Kingdom

Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...] in London employer: VirtueTech Recruitment Group

As a leading global Energy & Commodities trading house, we pride ourselves on fostering a dynamic and innovative work culture that empowers our employees to excel. With competitive salaries, performance bonuses, and comprehensive benefits, we offer exceptional growth opportunities within a collaborative environment where cutting-edge technology meets high-stakes trading. Join us in London to be part of a forward-thinking team that is shaping the future of energy trading through advanced data engineering.
VirtueTech Recruitment Group

Contact Detail:

VirtueTech Recruitment Group Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...] in London

✨Tip Number 1

Network like a pro! Reach out to folks in the industry, attend meetups, and connect on LinkedIn. The more people you know, the better your chances of landing that Senior Data Engineer role.

✨Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those involving ClickHouse or Azure Databricks. This will give potential employers a taste of what you can bring to their team.

✨Tip Number 3

Prepare for technical interviews by brushing up on your data engineering concepts. Be ready to discuss your experience with cloud-native platforms and how you've tackled high-volume data challenges in the past.

✨Tip Number 4

Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we love seeing candidates who are proactive about their job search.

We think you need these skills to ace Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...] in London

ClickHouse
Azure Databricks
Cloud-native Architecture
AI-driven Data Solutions
Data Ingestion Frameworks
ETL/ELT Pipelines
Data Modelling
Partitioning
Compression Techniques
Query Optimisation
Lakehouse Architecture
Real-time Data Processing
Python Programming
Analytical Workloads

Some tips for your application 🫡

Tailor Your CV: Make sure your CV speaks directly to the role of Senior Data Engineer. Highlight your experience with ClickHouse, Azure Databricks, and any relevant cloud-native platforms. We want to see how your skills align with our needs!

Showcase Your Projects: Include specific examples of projects where you've designed or optimised data solutions. We love seeing hands-on experience, especially if it relates to high-performance data clusters or lakehouse architectures.

Keep It Clear and Concise: Your application should be easy to read and straight to the point. Use bullet points for key achievements and avoid jargon unless it's relevant to the role. We appreciate clarity as much as complexity!

Apply Through Our Website: We encourage you to submit your application through our website. This helps us keep track of your application and ensures it gets to the right team quickly. Plus, it’s super easy to do!

How to prepare for a job interview at VirtueTech Recruitment Group

✨Know Your Tech Stack

Make sure you’re well-versed in ClickHouse, Azure Databricks, and any other relevant technologies mentioned in the job description. Brush up on your knowledge of cloud-native platforms and be ready to discuss how you've used them in past projects.

✨Showcase Your Problem-Solving Skills

Prepare to discuss specific challenges you've faced in data engineering, especially in high-volume environments. Think about how you approached these problems and the solutions you implemented, particularly around building scalable ETL/ELT pipelines.

✨Understand the Business Context

Familiarise yourself with the energy trading sector and the types of data challenges they face. Being able to connect your technical skills to real-world applications in trading, risk, and analytics will set you apart from other candidates.

✨Ask Insightful Questions

Prepare thoughtful questions that show your interest in the role and the company. Inquire about their current data architecture, future projects, or how they envision the integration of AI into their data platform. This demonstrates your enthusiasm and strategic thinking.

Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...] in London
VirtueTech Recruitment Group
Location: London

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>