Senior Data Engineer, 6 months, London/Hybrid, £600 - £660/day (INSIDE IR35) Energy/Trading experience is a MUST. Job Summary: We are looking for a highly skilled Senior Data Engineer with strong analytical skill, problem solving capabilities and hands‑on experience in building scalable data solutions. The ideal candidate will have expertise in Python, Databricks: PySpak, streaming architectures, data ingestion frameworks, and Performance/Cost Optimization Technique, along with experience working with SAP, ETRM data sources would be an added advantage. The candidate will be responsible for designing and implementing scalable data pipelines and enabling real‑time, batch analytics and across the program. Key Responsibilities: Design and implement scalable data pipelines using Databricks and Delta Live Tables (DLT). Develop and manage streaming data solutions for real‑time analytics and decision‑making. Ingest data from various sources-including SAP, ETRM systems using Qlik Replicate and ADF to ingest data from various sources ensuring data quality and consistency. Perform data modelling and optimize data structures for analytics and reporting. Collaborate with cross‑functional teams to understand data requirements and deliver robust solutions. Monitor, troubleshoot, and enhance data workflows for performance and reliability. Maintain technical documentation and contribute to data engineering best practices. Required Skills
Senior Data Engineer employer: Norton Blake Limited
As a Business Analyst at our London-based company, you'll thrive in a dynamic and collaborative work culture that values innovation and professional growth. We offer competitive rates, flexible hybrid working arrangements, and opportunities to engage in high-profile digital transformation projects, ensuring that your contributions are both meaningful and impactful. Join us to be part of a team that prioritises employee development and fosters a supportive environment for achieving excellence.
