At a Glance
- Tasks: Design and optimise high-performance data clusters for energy trading analytics.
- Company: Leading global Energy & Commodities trading house with a diverse trading ecosystem.
- Benefits: Up to £100K salary, bonus, and comprehensive benefits package.
- Other info: Exciting opportunity for career growth in a fast-paced, innovative environment.
- Why this job: Join a dynamic team to shape the future of AI-driven data platforms.
- Qualifications: Experience in data engineering, cloud-native platforms, and Python ETL/ELT pipelines.
The predicted salary is between 100000 - 100000 £ per year.
Senior Data Engineer is required for a leading global Energy & Commodities trading house — one of the world’s largest and most diverse general trading companies. Their trading ecosystem spans multiple commodities and markets, creating high-volume, high-velocity data challenges ideally suited to ClickHouse and modern data engineering.
As a Senior Data Engineer, you will play a pivotal role in choosing the right tooling, building and scaling a cloud-native AI-driven analytical data platform. You’ll be a senior member of the Core Engineering team, shaping the architecture and implementing high-performance data solutions used directly by trading, risk, analytics and operational teams.
This is a hands-on position where you’ll be working with a high-skilled small team of engineers while designing and developing a next-generation lakehouse architecture. Azure Databricks & ClickHouse will form the backbone of examples of two systems, supporting ultra-fast analytics, market-data ingestion, tick-data storage, and real-time insights for traders and quantitative teams.
What You’ll Do
- Design, build, and optimise high-performance ClickHouse / Azure Databricks / AI Cloud-native Data clusters for large-scale analytical workloads across commodities and energy trading.
- Develop ingestion frameworks for market data, pricing data, tick data, and trade/position datasets, leveraging ClickHouse’s columnar storage and real-time querying.
- Architect and maintain a modern lakehouse platform integrating ClickHouse with Databricks, Snowflake, and Azure-based services.
- Define and enforce best practices for data modelling, partitioning, compression, and query optimisation tailored for ClickHouse.
- Build scalable Python-based ETL/ELT pipelines and data services that deliver robust, low-latency data to trading, risk, and analytics teams.
If you are interested in this role, please send your CV to .
Location: London, England, United Kingdom
Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...] in England employer: VirtueTech Recruitment Group
Contact Detail:
VirtueTech Recruitment Group Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...] in England
✨Tip Number 1
Network like a pro! Reach out to folks in the industry on LinkedIn or at meetups. A friendly chat can lead to opportunities that aren’t even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those related to data engineering and cloud-native platforms. This gives you a chance to demonstrate your expertise beyond just a CV.
✨Tip Number 3
Prepare for interviews by brushing up on relevant technologies like ClickHouse and Azure Databricks. Be ready to discuss how you’d tackle real-world data challenges in energy trading.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive!
We think you need these skills to ace Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...] in England
Some tips for your application 🫡
Tailor Your CV: Make sure your CV speaks directly to the role of Senior Data Engineer. Highlight your experience with ClickHouse, Azure Databricks, and any relevant cloud-native platforms. We want to see how your skills align with the high-performance data solutions we’re looking to build.
Showcase Your Projects: Include specific examples of projects where you've designed or optimised data clusters or built ETL/ELT pipelines. We love seeing hands-on experience, so don’t hold back on the details that show off your technical prowess!
Keep It Clear and Concise: While we appreciate detail, clarity is key! Make sure your application is easy to read and straight to the point. Use bullet points for your achievements and keep your language professional yet approachable.
Apply Through Our Website: We encourage you to apply through our website for a smoother process. It helps us keep track of applications and ensures you get the best chance at showcasing your fit for the role. Don’t miss out!
How to prepare for a job interview at VirtueTech Recruitment Group
✨Know Your Tech Stack
Make sure you’re well-versed in ClickHouse, Azure Databricks, and any other relevant technologies mentioned in the job description. Brush up on your knowledge of cloud-native platforms and be ready to discuss how you've used them in past projects.
✨Showcase Your Problem-Solving Skills
Prepare to discuss specific challenges you've faced in data engineering, especially related to high-volume data processing. Think about examples where you’ve optimised performance or built scalable solutions, as these will resonate with the interviewers.
✨Understand the Business Context
Familiarise yourself with the energy trading sector and the types of data challenges they face. Being able to connect your technical skills to real-world applications in trading, risk, and analytics will set you apart from other candidates.
✨Ask Insightful Questions
Prepare thoughtful questions about the company’s current data architecture and future plans for their lakehouse platform. This shows your genuine interest in the role and helps you gauge if the company is the right fit for you.