At a Glance
- Tasks: Lead data acquisition strategies and build scalable pipelines on Azure for a global Energy company.
- Company: Join a world-leading Energy company transforming into a future-focused leader.
- Benefits: Competitive salary, career development, and the chance to work with cutting-edge technology.
- Other info: Exciting opportunities for growth in a transparent and reliable recruitment environment.
- Why this job: Make a real impact in the energy sector while leading a dynamic team of data engineers.
- Qualifications: 10+ years in data engineering with strong Azure and Python skills; leadership experience required.
The predicted salary is between 80000 - 100000 € per year.
Exciting opportunity for a Data Engineering Lead (Data Acquisition) to join this global Energy company. This is an exciting time to join this world-leading Energy company as it evolves from a traditional Oil & Gas enterprise into a future-focused Energy leader. You will lead a data acquisition function within an Energy Trading & Supply organisation, owning ingestion strategy, pipeline delivery on Azure and a team of data engineers serving Trading, Risk, Finance and Operations.
Key Responsibilities
- Own and define the data ingestion strategy; design and build scalable pipelines on Azure (ADLS, ADF, Databricks, Synapse, Event Hubs/Kafka) with robust observability and SLAs.
- Translate requirements from trading, risk, operations and finance into a prioritised engineering backlog, working closely with architects and product owners.
- Serve as the domain's Data Manager, stewarding data definitions, lineage, quality, metadata and access policies.
- Lead, coach and develop a team of data engineers, driving high standards in coding, design and production operations.
- Ensure data platforms are resilient, secure and compliant with relevant trading regulations (REMIT/EMIR).
Experience & Skills
- 10+ years in data engineering, with 3–5 years leading teams in complex, real-time environments.
- Strong hands-on expertise in Azure data services and Python, SQL, Spark/PySpark.
- Solid understanding of streaming and batch ingestion patterns, schema management and API integration.
- Proven ability to lead engineering teams in an Agile/DevOps environment with CI/CD practices.
- Experience with energy trading systems (ETRM/Endur), market data platforms (ICE, Platts, Bloomberg) and SAP is advantageous.
- Degree in Computer Science/Engineering or equivalent; Azure or Databricks certifications desirable.
With a focus within Energy Trading, Oil & Gas, Financial Markets and Commodities, we offer a transparent Recruitment Service that has proven to be reliable and effective for over 40 years. We are ISO accredited and proud of our excellent TrustPilot Reviews.
Data Engineering Lead : Data Acquisition in London employer: Eaglecliff Recruitment
Join a world-leading Energy company at the forefront of the transition from traditional Oil & Gas to innovative energy solutions. As a Data Engineering Lead, you will thrive in a dynamic work culture that prioritises collaboration and professional growth, with opportunities to lead a talented team while working on cutting-edge Azure technologies. Enjoy competitive benefits and a commitment to employee development in a sector that is pivotal for the future of energy.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineering Lead : Data Acquisition in London
✨Tip Number 1
Network like a pro! Reach out to your connections in the energy sector and let them know you're on the hunt for a Data Engineering Lead role. You never know who might have the inside scoop on an opportunity or can put in a good word for you.
✨Tip Number 2
Show off your skills! Prepare a portfolio or a project showcase that highlights your experience with Azure data services, Python, and SQL. This will give potential employers a tangible sense of what you can bring to the table.
✨Tip Number 3
Ace the interview by doing your homework! Research the company’s recent projects and challenges in the energy sector. Tailor your answers to show how your expertise in data ingestion strategies and team leadership can help them achieve their goals.
✨Tip Number 4
Don’t forget to apply through our website! We’ve got a streamlined process that makes it easy for you to submit your application and get noticed. Plus, we’re always on the lookout for talented individuals like you to join our team!
We think you need these skills to ace Data Engineering Lead : Data Acquisition in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Data Engineering Lead role. Highlight your experience with Azure data services, Python, and team leadership. We want to see how your skills align with our needs!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're excited about this opportunity and how your background in data engineering makes you the perfect fit for our team.
Showcase Relevant Projects:If you've worked on projects involving data ingestion strategies or pipeline delivery, make sure to mention them. We love seeing real-world examples of your expertise in action!
Apply Through Our Website:Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity in our evolving Energy company.
How to prepare for a job interview at Eaglecliff Recruitment
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure data services, Python, SQL, and Spark/PySpark. Brush up on your knowledge of streaming and batch ingestion patterns, as well as API integration. Being able to discuss these technologies confidently will show that you're the right fit for the role.
✨Understand the Business Context
Familiarise yourself with the energy trading landscape, including systems like ETRM/Endur and market data platforms such as ICE and Bloomberg. This will help you translate technical requirements into business value during the interview, demonstrating your ability to bridge the gap between tech and business needs.
✨Showcase Your Leadership Skills
Prepare examples of how you've led teams in Agile/DevOps environments. Discuss your experience in coaching and developing engineers, and how you’ve driven high standards in coding and production operations. This will highlight your capability to lead the data acquisition function effectively.
✨Ask Insightful Questions
Prepare thoughtful questions about the company’s data ingestion strategy and how they ensure compliance with trading regulations. This not only shows your interest in the role but also your understanding of the complexities involved in data management within the energy sector.
