At a Glance
- Tasks: Design and optimise high-performance data clusters for energy trading analytics.
- Company: Join a leading global Energy & Commodities trading house with diverse opportunities.
- Benefits: Earn up to £100K plus bonuses and great benefits.
- Why this job: Shape the future of data engineering in a cutting-edge, cloud-native environment.
- Qualifications: Experience in data engineering, particularly with ClickHouse and Azure Databricks.
- Other info: Collaborate with a skilled team and enjoy excellent career growth in London.
The predicted salary is between 72000 - 84000 £ per year.
Senior Data Engineer is required for a leading global Energy & Commodities trading house — one of the world’s largest and most diverse general trading companies. Their trading ecosystem spans multiple commodities and markets, creating high-volume, high-velocity data challenges ideally suited to ClickHouse and modern data engineering.
As a Senior Data Engineer, you will play a pivotal role in choosing the right tooling, building and scaling a cloud-native AI-driven analytical data platform. You’ll be a senior member of the Core Engineering team, shaping the architecture and implementing high-performance data solutions used directly by trading, risk, analytics and operational teams.
This is a hands-on position where you’ll be working with a high-skilled small team of engineers while designing and developing a next-generation lakehouse architecture. Azure Databricks & ClickHouse will form the backbone of examples of two systems, supporting ultra-fast analytics, market-data ingestion, tick-data storage, and real-time insights for traders and quantitative teams.
Salary: Up to £100,000 per annum + Bonus & Benefits
What You’ll Do:
- Design, build, and optimise high-performance ClickHouse / Azure Databricks / AI Cloud-native Data clusters for large-scale analytical workloads across commodities and energy trading.
- Develop ingestion frameworks for market data, pricing data, tick data, and trade/position datasets, leveraging ClickHouse’s columnar storage and real-time querying.
- Architect and maintain a modern lakehouse platform integrating ClickHouse with Databricks, Snowflake, and Azure-based services.
- Define and enforce best practices for data modelling, partitioning, compression, and query optimisation tailored for ClickHouse.
- Build scalable Python-based ETL/ELT pipelines and data services that deliver robust, low-latency data to trading, risk, and analytics teams.
If you are interested in this role, please send your CV to ross@virtuetech.io.
Location: London, England, United Kingdom
Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...] employer: VirtueTech Recruitment Group
Contact Detail:
VirtueTech Recruitment Group Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...]
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who works in energy trading. Building relationships can open doors that a CV just can't.
✨Show Off Your Skills
When you get the chance to chat with potential employers, don’t hold back! Share your experiences with ClickHouse, Azure Databricks, and any cool projects you've worked on. Let them see how you can add value to their team.
✨Tailor Your Approach
Every company is different, so do your homework! Understand their tech stack and challenges, and be ready to discuss how your skills can help them tackle those issues. This shows you're genuinely interested and not just sending out generic applications.
✨Apply Through Our Website
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who take that extra step to engage with us directly.
We think you need these skills to ace Senior Data Engineer | Energy Trading | Agnostic - Cloud-native AI Centric Data Platform | Next[...]
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Senior Data Engineer role. Highlight your experience with ClickHouse, Azure Databricks, and any relevant cloud-native platforms. We want to see how your skills align with the job description!
Showcase Your Projects: Include specific projects where you've designed or optimised data solutions. If you've built a lakehouse architecture or worked on high-performance data clusters, let us know! Real-world examples can really make your application stand out.
Keep It Clear and Concise: When writing your application, keep it clear and to the point. Use bullet points for easy reading and avoid jargon unless it's relevant. We appreciate straightforward communication that gets to the heart of your experience.
Apply Through Our Website: We encourage you to apply through our website for the best chance of getting noticed. Make sure to follow the application instructions carefully and double-check your details before hitting send!
How to prepare for a job interview at VirtueTech Recruitment Group
✨Know Your Tech Stack
Make sure you’re well-versed in ClickHouse, Azure Databricks, and any other relevant technologies mentioned in the job description. Brush up on your knowledge of cloud-native platforms and be ready to discuss how you've used them in past projects.
✨Showcase Your Problem-Solving Skills
Prepare to discuss specific challenges you've faced in data engineering, especially in high-volume environments. Think about examples where you’ve optimised performance or built scalable solutions, and be ready to explain your thought process.
✨Understand the Business Context
Familiarise yourself with the energy trading sector and the types of data challenges they face. Being able to connect your technical skills to real-world applications in trading, risk, and analytics will set you apart from other candidates.
✨Ask Insightful Questions
Prepare thoughtful questions about the company’s current data architecture and future plans for their lakehouse platform. This shows your genuine interest in the role and helps you assess if the company is the right fit for you.