At a Glance
- Tasks: Design and maintain high-throughput data pipelines for real-time trading decisions.
- Company: Our client is a major commodity trader with 40 global offices.
- Benefits: Work in a dynamic environment with evolving requirements and cutting-edge technology.
- Other info: Experience in financial services and exposure to trading or commodity business is essential.
- Why this job: Join a team processing over 50 billion rows of data daily, directly impacting trading decisions.
- Qualifications: 5+ years in data engineering with proficiency in Python, SQL, and AWS required.
The predicted salary is between 60000 - 80000 £ per year.
Our client is a major commodity trader with 40 offices across the globe. We are recruiting a mid‑senior Data Engineer with a background in Python, SQL, and AWS to build data pipelines and dashboards that inform trading decisions daily. The Data Engineering team is responsible for a fundamental data system processing 50+ billion rows of data per day and feeding directly into trading decisions. The Data Engineer will be designing, implementing, and maintaining this system, keeping it reliable, resilient, and low‑latency.
Responsibilities
- Design, implement, and maintain high‑throughput data pipelines that support real‑time trading decisions.
- Partner closely with business stakeholders and engineering teams to understand data requirements and deliver the necessary infrastructure.
- Collaborate in a dynamic environment with evolving requirements.
Qualifications
- 5+ years in the data engineering space.
- Proficient with MPP databases (Snowflake (preferred), Redshift, Big Query, Azure DW).
- Deep AWS or cloud understanding across core and extended services.
- 2+ years experience working with at least 3 of the following: ECS, EKS, Lambda.
- Proficient with Python and SQL, and with good experience with data modeling.
- Experience with a modern orchestration tool (Airflow / Prefect / Dagster / similar).
- Comfortable working in a dynamic environment with evolving requirements.
- A background in a dynamic financial services environment (Investment Bank, Hedge Fund).
- BSc in Computer Science from a Russell Group University.
- Exposure to trading and/or commodity business.
- DBT experience.
- Infrastructure as Code (Terraform, Cloud Formation, Ansible).
Data Engineer - Energy Trading - London employer: Options Group
This major commodity trader operates 40 offices worldwide, offering a dynamic work environment. Employees benefit from cutting-edge technology and the opportunity to influence trading decisions directly. The team values collaboration and innovation in a fast-paced industry.
