At a Glance
- Tasks: Design and maintain high-throughput data pipelines for real-time trading decisions.
- Company: Our client is a major commodity trader with 40 global offices.
- Benefits: Work in a dynamic environment with evolving requirements and cutting-edge technology.
- Other info: Experience in financial services and exposure to trading or commodity business is essential.
- Why this job: Join a team processing over 50 billion rows of data daily, directly impacting trading decisions.
- Qualifications: 5+ years in data engineering with proficiency in Python, SQL, and AWS required.
The predicted salary is between 60000 - 80000 £ per year.
Our client is a major commodity trader with 40 offices across the globe. We are recruiting a mid‑senior Data Engineer with a background in Python, SQL, and AWS to build data pipelines and dashboards that inform trading decisions daily. The Data Engineering team is responsible for a fundamental data system processing 50+ billion rows of data per day and feeding directly into trading decisions. The Data Engineer will be designing, implementing, and maintaining this system, keeping it reliable, resilient, and low‑latency.
Responsibilities
- Design, implement, and maintain high‑throughput data pipelines that support real‑time trading decisions.
- Partner closely with business stakeholders and engineering teams to understand data requirements and deliver the necessary infrastructure.
- Collaborate in a dynamic environment with evolving requirements.
Qualifications
- 5+ years in the data engineering space.
- Proficient with MPP databases (Snowflake (preferred), Redshift, Big Query, Azure DW).
- Deep AWS or cloud understanding across core and extended services.
- 2+ years experience working with at least 3 of the following: ECS, EKS, Lambda.
- Proficient with Python and SQL, and with good experience with data modeling.
- Experience with a modern orchestration tool (Airflow / Prefect / Dagster / similar).
- Comfortable working in a dynamic environment with evolving requirements.
- A background in a dynamic financial services environment (Investment Bank, Hedge Fund).
- BSc in Computer Science from a Russell Group University.
- Exposure to trading and/or commodity business.
- DBT experience.
- Infrastructure as Code (Terraform, Cloud Formation, Ansible).
Data Engineer - Energy Trading - London employer: Options Group
Options Group is an excellent employer, offering a vibrant work culture that fosters collaboration and innovation within the private markets investment team in Greater London. Employees benefit from comprehensive learning and development opportunities, competitive compensation, and the chance to work on impactful projects in private equity secondaries and co-investments, making it a rewarding environment for aspiring finance professionals.
