Data Engineering Lead (Data Acquisition) in London

Data Engineering Lead (Data Acquisition) in London

London Full-Time 80000 - 100000 € / year (est.) No home office possible
E

At a Glance

  • Tasks: Lead data acquisition for a global Energy company, designing scalable pipelines on Azure.
  • Company: Join a world-leading Energy company transforming into a future-focused leader.
  • Benefits: Competitive salary, career growth, and the chance to work with cutting-edge energy solutions.
  • Other info: Exciting opportunities in a fast-paced environment with a focus on innovation.
  • Why this job: Make a real impact in the evolving Energy sector while leading a dynamic team.
  • Qualifications: 10+ years in data engineering, strong Azure expertise, and leadership experience required.

The predicted salary is between 80000 - 100000 € per year.

Exciting opportunity for a Data Engineering Lead (Data Acquisition) to join this global Energy company. This is an exciting time to join this world‑leading Energy company as it evolves from a traditional Oil & Gas enterprise into a future‑focused Energy leader. This transformation includes the establishment of a highly successful new Power Trading desk within the Energy Trading team and ventures into cutting‑edge solutions that address the evolving demands of the Energy sector. These initiatives include advanced Gas infrastructure, LNG technology, effective Energy Storage systems and Green Energy solutions.

You will lead a data acquisition function within an Energy Trading & Supply organisation, owning ingestion strategy, pipeline delivery on Azure, and a team of data engineers serving Trading, Risk, Finance and Operations.

Key Responsibilities
  • Own and define the data ingestion strategy; design and build scalable pipelines on Azure (ADLS, ADF, Databricks, Synapse, Event Hubs/Kafka) with robust observability and SLAs.
  • Translate requirements from trading, risk, operations and finance into a prioritised engineering backlog, working closely with architects and product owners.
  • Serve as the domain’s Data Manager, stewarding data definitions, lineage, quality, metadata and access policies.
  • Lead, coach and develop a team of data engineers, driving high standards in coding, design and production operations.
  • Ensure data platforms are resilient, secure and compliant with relevant trading regulations (REMIT/EMIR).
Experience & Skills
  • 10+ years in data engineering, with 3-5 years leading teams in complex, real‑time environments.
  • Strong hands‑on expertise in Azure data services and Python, SQL, Spark/PySpark.
  • Solid understanding of streaming and batch ingestion patterns, schema management and API integration.
  • Proven ability to lead engineering teams in an Agile/DevOps environment with CI/CD practices.
  • Experience with energy trading systems (ETRM/Endur), market data platforms (ICE, Platts, Bloomberg) and SAP is advantageous.
  • Degree in Computer Science/Engineering or equivalent; Azure or Databricks certifications desirable.

Data Engineering Lead (Data Acquisition) in London employer: Eaglecliff

Join a world-leading Energy company at the forefront of transforming the sector, where innovation meets sustainability. As a Data Engineering Lead, you will thrive in a dynamic work culture that prioritises collaboration and professional growth, with access to cutting-edge technologies and a commitment to employee development. Enjoy the unique advantage of working in a global organisation that is dedicated to shaping the future of energy, while being part of a team that values your expertise and contributions.

E

Contact Detail:

Eaglecliff Recruiting Team

StudySmarter Expert Advice🤫

We think this is how you could land Data Engineering Lead (Data Acquisition) in London

Tip Number 1

Network like a pro! Reach out to folks in the energy sector, especially those working in data engineering. Attend industry events or webinars, and don’t be shy about sliding into DMs on LinkedIn. You never know who might have the inside scoop on job openings!

Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure and data pipelines. This is your chance to demonstrate your hands-on expertise and make a lasting impression during interviews.

Tip Number 3

Prepare for technical interviews by brushing up on your coding skills and understanding of data ingestion strategies. Practice common data engineering problems and be ready to discuss your experience with Azure services and Agile methodologies.

Tip Number 4

Don’t forget to apply through our website! We’re always on the lookout for talented individuals like you. Tailor your application to highlight your leadership experience and how you can contribute to our exciting transformation in the energy sector.

We think you need these skills to ace Data Engineering Lead (Data Acquisition) in London

Data Ingestion Strategy
Azure Data Services
Python
SQL
Spark/PySpark
Streaming and Batch Ingestion Patterns
Schema Management

Some tips for your application 🫡

Tailor Your CV:Make sure your CV is tailored to the Data Engineering Lead role. Highlight your experience with Azure data services and any relevant projects you've led. We want to see how your skills align with our exciting transformation in the Energy sector!

Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about the energy industry and how your background makes you the perfect fit for leading our data acquisition function. Let us know what excites you about this opportunity!

Showcase Your Leadership Skills:Since you'll be leading a team of data engineers, make sure to highlight your leadership experience. Share examples of how you've coached teams in Agile environments and driven high standards in coding and design. We love seeing strong leaders!

Apply Through Our Website:Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity. We can’t wait to see what you bring to the table!

How to prepare for a job interview at Eaglecliff

Know Your Tech Inside Out

Make sure you’re well-versed in Azure data services, Python, SQL, and Spark/PySpark. Brush up on your knowledge of streaming and batch ingestion patterns, as well as API integration. Being able to discuss these technologies confidently will show that you’re the right fit for the role.

Understand the Energy Sector

Familiarise yourself with the current trends in the energy sector, especially around green energy solutions and trading systems. Knowing how your role as a Data Engineering Lead fits into the bigger picture of the company’s transformation will impress the interviewers.

Prepare Real-World Examples

Think of specific instances where you’ve led teams or projects in complex environments. Be ready to share how you’ve implemented CI/CD practices or managed data ingestion strategies. Concrete examples will help demonstrate your leadership skills and technical expertise.

Ask Insightful Questions

Prepare thoughtful questions about the company’s data strategy and how they envision the future of their Power Trading desk. This shows your genuine interest in the role and helps you gauge if the company aligns with your career goals.