Senior Data Engineer – Short Term Power Markets

Castleton Commodities International (https://www.cci.com) is a global leader in energy commodity trading and asset investment. Our Data Science & Technology team is central to our success, engineering the high-performance data, systems and innovative tools that power our commercial decision-making. We build platforms and forecasts that help our front‑office teams understand market behaviour, forecast price movements, and manage risk. Our team solves complex, high‑impact challenges using a modern technology stack, including the latest in GenAI and the latest technologies. We develop everything in cloud‑native infrastructure from structured data and real-time analytics to back‑testing engines, third‑party integrations, and internal libraries, all designed to give CCI a competitive edge in global commodities markets. This role is an opportunity to build solutions that have a direct commercial impact from day one.

Responsibilities

• Design, build, and maintain scalable data pipelines to deliver real‑time and historical data for back‑testing, modeling, and execution of trading strategies.
• Integrate and manage data feeds from multiple sources, including fundamental market data, grid operations, weather providers, and internal trading systems.
• Collaborate closely with Technology and Trading teams to ensure the timely availability and reliability of data across all systems supporting the Intraday Power desk.
• Organise and structure Power data, including both reference and transactional data.
• Monitor, troubleshoot, and optimise streaming data infrastructure, proactively resolving issues to minimise downtime and ensure data integrity.
• Partner with Technology & Commercial teams to enhance the back‑testing and signal generation frameworks that support systematic trading models.
• Implement best practices in data governance, versioning, and lineage, ensuring compliance and traceability across the data stack.
• Develop internal tools, APIs, and dashboards that improve data accessibility, transparency, and usability for Traders & Analysts.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field of study.
• 5 – 10 years of professional experience as a Senior Data Engineer, preferably supporting Intraday Short‑Term Power trading or similar real‑time energy market environments.
• Experience working with energy commodity time‑series datasets is required; familiarity with short‑term power market data sources such as EPEX, ENTSO‑E, or Nord Pool is strongly preferred but not required.
• Understanding of systematic trading workflows, including signal generation, back‑testing, and model validation.
• Proven ability to work in a high‑frequency, intraday trading environment with tight feedback loops between data, models, and execution.
• Experience with ETL/ELT frameworks to write pipelines to load millions/billions of records.
• Advanced skills in writing highly optimised SQL code.
• Hands‑on experience developing data solutions in Python, Pandas, Numpy, etc.
• Experience with relational databases; Snowflake highly preferred.
• Strong communication skills, with the ability to convey complex technical concepts to non‑technical stakeholders.

Employee Programs & Benefits

• Competitive comprehensive medical, dental, retirement and life insurance benefits
• Employee assistance & wellness programmes
• Parental and family leave policies
• CCI in the Community: Each office has a Charity Committee and as part of this program employees are allocated 2 days annually to volunteer at the selected charities.
• Charitable contribution match programme
• Tuition assistance & reimbursement
• Quarterly Innovation & Collaboration Awards
• Employee discount programme, including access to fitness facilities
• Competitive paid time off
• Continued learning opportunities

Visit https://www.cci.com/careers/life-at-cci/# to learn more!