Data Engineering Lead (Data Acquisition)
Data Engineering Lead (Data Acquisition)

Data Engineering Lead (Data Acquisition)

Full-Time 80000 - 100000 £ / year (est.) No home office possible
E

At a Glance

  • Tasks: Lead data acquisition strategies and build scalable pipelines on Azure for a global Energy company.
  • Company: Join a world-leading Energy company transforming into a future-focused leader.
  • Benefits: Competitive salary, career growth, and the chance to work with cutting-edge energy solutions.
  • Other info: Exciting opportunities in a fast-paced environment with a focus on innovation and sustainability.
  • Why this job: Make a real impact in the evolving Energy sector while leading a dynamic team.
  • Qualifications: 10+ years in data engineering with strong Azure and Python skills; leadership experience required.

The predicted salary is between 80000 - 100000 £ per year.

Exciting opportunity to join a global Energy company. This is an exciting time to join this world‑leading Energy company as it evolves from a traditional Oil & Gas enterprise into a future‑focused Energy leader. This transformation includes the establishment of a highly successful new Power Trading desk within the Energy Trading team and ventures into cutting‑edge solutions that address the evolving demands of the Energy sector. These initiatives include advanced Gas infrastructure, LNG technology, effective Energy Storage systems and Green Energy solutions.

You will lead a data acquisition function within an Energy Trading & Supply organisation, owning ingestion strategy, pipeline delivery on Azure, and a team of data engineers serving Trading, Risk, Finance and Operations.

Key Responsibilities
  • Own and define the data ingestion strategy; design and build scalable pipelines on Azure (ADLS, ADF, Databricks, Synapse, Event Hubs/Kafka) with robust observability and SLAs.
  • Translate requirements from trading, risk, operations and finance into a prioritised engineering backlog, working closely with architects and product owners.
  • Serve as the domain’s Data Manager, stewarding data definitions, lineage, quality, metadata and access policies.
  • Lead, coach and develop a team of data engineers, driving high standards in coding, design and production operations.
  • Ensure data platforms are resilient, secure and compliant with relevant trading regulations (REMIT/EMIR).
Experience & Skills
  • 10+ years in data engineering, with 3-5 years leading teams in complex, real‑time environments.
  • Strong hands‑on expertise in Azure data services and Python, SQL, Spark/PySpark.
  • Solid understanding of streaming and batch ingestion patterns, schema management and API integration.
  • Proven ability to lead engineering teams in an Agile/DevOps environment with CI/CD practices.
  • Experience with energy trading systems (ETRM/Endur), market data platforms (ICE, Platts, Bloomberg) and SAP is advantageous.
  • Degree in Computer Science/Engineering or equivalent; Azure or Databricks certifications desirable.

Data Engineering Lead (Data Acquisition) employer: Eaglecliff

Join a world-leading Energy company that is at the forefront of transforming the energy sector. As a Data Engineering Lead, you will thrive in a dynamic work culture that prioritises innovation and collaboration, with ample opportunities for professional growth and development. Located in a vibrant area, the company offers competitive benefits and a commitment to sustainability, making it an excellent employer for those seeking meaningful and impactful work.
E

Contact Detail:

Eaglecliff Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Data Engineering Lead (Data Acquisition)

✨Tip Number 1

Network like a pro! Reach out to folks in the energy sector, especially those working in data engineering. Attend industry events or webinars and don’t be shy about striking up conversations. You never know who might have the inside scoop on job openings!

✨Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure and data pipelines. This is your chance to demonstrate your hands-on expertise and make a lasting impression during interviews.

✨Tip Number 3

Prepare for technical interviews by brushing up on your knowledge of data ingestion strategies and Azure services. Practice explaining complex concepts in simple terms, as you’ll need to communicate effectively with both technical and non-technical stakeholders.

✨Tip Number 4

Don’t forget to apply through our website! We’re always on the lookout for talented individuals like you. Tailor your application to highlight your experience in leading teams and working in Agile environments, and let’s get you on board!

We think you need these skills to ace Data Engineering Lead (Data Acquisition)

Data Ingestion Strategy
Azure Data Services
Python
SQL
Spark/PySpark
Streaming and Batch Ingestion Patterns
Schema Management
API Integration
Agile/DevOps Practices
CI/CD Practices
Energy Trading Systems (ETRM/Endur)
Market Data Platforms (ICE, Platts, Bloomberg)
SAP
Team Leadership
Data Quality Management

Some tips for your application 🫡

Tailor Your CV: Make sure your CV speaks directly to the job description. Highlight your experience with Azure data services and any relevant projects you've led. We want to see how your skills align with our needs!

Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're excited about this role and how your background in data engineering makes you the perfect fit for our team. Let your passion for the energy sector come through!

Showcase Your Leadership Skills: Since this role involves leading a team, make sure to highlight your leadership experience. Share examples of how you've coached teams in the past and driven high standards in coding and design. We love seeing strong leaders!

Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity. Don’t miss out on joining our innovative team!

How to prepare for a job interview at Eaglecliff

✨Know Your Tech Inside Out

Make sure you’re well-versed in Azure data services, Python, SQL, and Spark/PySpark. Brush up on your knowledge of streaming and batch ingestion patterns, as well as API integration. Being able to discuss these technologies confidently will show that you're the right fit for the role.

✨Understand the Business Context

Familiarise yourself with the energy sector, especially how trading, risk, finance, and operations intersect. Knowing the latest trends in green energy solutions and advanced gas infrastructure can help you relate your technical skills to the company's goals during the interview.

✨Prepare for Team Leadership Questions

Since this role involves leading a team of data engineers, be ready to share your experiences in coaching and developing others. Think of specific examples where you’ve driven high standards in coding and design, and how you’ve fostered an Agile/DevOps environment.

✨Showcase Your Problem-Solving Skills

Be prepared to discuss how you would approach defining a data ingestion strategy or resolving issues related to data quality and compliance. Use real-life scenarios to illustrate your thought process and problem-solving abilities, which are crucial for this role.

Data Engineering Lead (Data Acquisition)
Eaglecliff

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>