Contract: Initial 6-month contract (long-term transformation programme)
X4 Technology are partnered with a major energy trading organisation on a strategic programme to unlock the power of their data across Trading, driving sharper decision-making and new cross-commodity trading opportunities.
Key focuses are pulling analysis out of Excel, unlocking modern visualisation tools and building out a proper Databricks-powered data platform to give trading desks real, near-term value from their data.
Joining as Data Engineer, you'll own data products end-to-end - from design and build through to deployment and live support - combining serious data engineering experience with strong backend/API development.
Responsibilities for the Data Engineer
- Design, build and maintain scalable data pipelines and data products using Python, PySpark, Databricks and SQL Server
- Develop and support modern REST APIs and backend services using FastAPI - a genuine hands-on API-building role, not just pipelines
- Own engineering end-to-end across the full SDLC - design, build, test, deploy, monitor and support - working closely with stakeholders, product owners, architects and engineers to turn requirements into robust solutions
- Build and maintain CI/CD pipelines, automated testing and release automation via GitHub Actions, plus containerised deployments using Docker and Kubernetes
- Champion engineering best practice - code reviews, automated testing, security, observability and operational excellence
Requirements for the Data Engineer
- Strong hands-on Python, PySpark, Databricks and SQL Server experience
- Strong, proven FastAPI experience - this is essential, not a nice-to-have
- Solid Azure cloud experience, plus Docker, Kubernetes and GitOps
- Strong understanding of data architecture, data modelling and data governance principles
- Excellent stakeholder engagement - comfortable with both technical and non-technical audiences
A brilliant opportunity to build modern, cloud-native data products at the heart of a major trading business's data transformation - full ownership from design to production, with real influence over how the platform evolves.
#J-18808-Ljbffr
Data Engineer (Energy Trading) employer: X4 Technology
Join a leading global energy trading business that values its employees and fosters a dynamic work culture. With a hybrid working model in London, you will enjoy a competitive salary, substantial bonuses, and opportunities for professional growth while working closely with traders and senior stakeholders on high-value transactions. This role offers the chance to make a meaningful impact in a fast-paced environment, ensuring your contributions are recognised and rewarded.