At a Glance
- Tasks: Lead data acquisition strategies and build high-quality pipelines on Azure.
- Company: Join Shell, a leader in energy transition and innovation.
- Benefits: Competitive salary, flexible working options, and extensive training opportunities.
- Other info: Diverse and inclusive workplace with excellent career growth potential.
- Why this job: Make a real impact in the energy sector while developing your skills.
- Qualifications: Experience in data engineering and team leadership; Azure expertise preferred.
The predicted salary is between 80000 - 100000 £ per year.
As a Data Engineering Lead (Data Acquisition), you will lead Shell Energy Trading & Supply’s data acquisition function: own the ingestion strategy and build pipelines on Azure; act as the bridge from end-user needs to engineered solutions; serve as the domain’s go-to Data Manager for mastership, lineage, and quality; and lead a team of data engineers to deliver reliable, compliant, high-value data to Trading, Risk, Finance, and Operations.
What you’ll be doing
- Own the ingestion strategy & build high-quality pipelines.
- Define target-state patterns for batch/streaming ingestion; standardize connectors, schemas, contracts and controls.
- Lead design and build on Azure data platforms (ADLS, ADF, Databricks, Synapse, Event Hubs/Kafka), with CI/CD, IaC and automated testing.
- Industrialize onboarding of sources (ETRM/Endur, Trayport, market data vendors, SAP, SCADA/IoT) with SLAs, observability and runbooks.
- Bridge end‑user requests to engineered solutions.
- Translate trading desk, risk, operations and finance requirements into a prioritized acquisition backlog; shape epics/stories with clear acceptance criteria.
- Partner with Product Owners, Business Interface and Solution/Data Architects to align designs, models and mastership decisions for the domain.
- Steward data definitions, ownership, lineage, metadata, quality KPIs and access policies; chair data change forums.
- Apply Shell’s technical information & data lifecycle: register, receive, set up/load, update/maintain, publish/archive or dispose; uphold audit trail and records management.
- Build a high-performing, inclusive team; coach in coding standards, design reviews, performance tuning and production operations.
- Shape capacity plans, skills roadmap and vendor contributions; foster a culture of safety, compliance and continuous improvement.
- Ensure resilience, recoverability and cyber hygiene; meet controls for data privacy, confidentiality and regulatory obligations in trading (e.g., REMIT/EMIR, privacy).
- Drive incident, change & problem management; measure and report service health and user satisfaction.
What you bring
- Extensive experience in data engineering, with proven years leading teams/products in complex, real‑time data environments.
- Expertise in Azure data services (ADLS, ADF, Databricks, Synapse, Event Hub/Kafka), Python, SQL, Spark/PySpark.
- Strong knowledge of streaming and batch patterns, schema management, CDC, API integration.
- Experience with data modelling, metadata and lineage tooling; performance & cost optimization.
- Proven leadership in engineering teams; Agile/DevOps ways of working; CI/CD; test automation.
- Preferred: exposure to energy trading systems (ETRM/Endur), market data (ICE, Platts, Bloomberg), SAP.
- Degree in Computer Science/Engineering or equivalent experience; Azure Data Engineer or Databricks certifications a plus.
What we offer
- You bring your skills and experience to Shell and in return you work with talented, committed people on one of the most important challenges facing our planet.
- You’ll have the opportunity to develop the skills you need to grow in an environment where we value honesty, integrity, and respect for one another.
- You’ll be able to balance your priorities as you become the best version of yourself.
- Progress as a person as we work on the energy transition together.
- Continuously grow the transferable skills you need to get ahead.
- Work at the forefront of technology, trends, and practices.
- Collaborate with experienced colleagues with unique expertise.
- Achieve your balance in a values-led culture that encourages you to be the best version of yourself.
- Benefit from a range of flexible working options.
- Perform at your best with a competitive starting salary and annual performance related salary increase.
- Take advantage of paid parental leave, including for non-birthing parents.
- Join an organisation working to become one of the most diverse and inclusive in the world.
- Grow as you progress through diverse career opportunities in national and international teams.
- Gain access to a wide range of training and development programmes.
We are committed to attracting a broader and more diverse pool of candidates. If this position doesn’t feel like the perfect fit for your qualifications right now, we’d still love to hear from you. Shell is working to advance an inclusive, psychologically safe and accessible environment where people with disabilities can excel. If you require any accommodations or accessibility adjustments during the application or interview process, please let us know when prompted in your application.
Data Engineering Lead (Data Acquisition) employer: Shell
At Shell, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration. As a Data Engineering Lead in the UK, you will not only lead a talented team but also have access to extensive training and development opportunities, competitive salaries, and flexible working options, all while contributing to the vital energy transition. Join us in making a meaningful impact as we strive for a diverse and inclusive workplace where every employee can thrive.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineering Lead (Data Acquisition)
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, especially those already at Shell. A friendly chat can open doors and give you insider info on what they're really looking for.
✨Tip Number 2
Prepare for the interview by diving deep into Azure data services. Brush up on your Python and SQL skills, and be ready to discuss how you've tackled real-time data challenges in the past.
✨Tip Number 3
Showcase your leadership skills! Be ready to share examples of how you've built and led teams, especially in Agile environments. We want to see how you can inspire others to deliver high-quality data solutions.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets the attention it deserves. Plus, we love seeing candidates who take that extra step.
We think you need these skills to ace Data Engineering Lead (Data Acquisition)
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Data Engineering Lead role. Highlight your experience with Azure data services and any leadership roles you've had. We want to see how your skills match what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about data engineering and how you can contribute to our team. Be sure to mention specific projects or experiences that relate to the job description.
Showcase Your Technical Skills:Don’t forget to highlight your technical expertise in Python, SQL, and Spark/PySpark. We’re keen on seeing how you’ve applied these skills in real-time data environments, so give us some examples!
Apply Through Our Website:We encourage you to apply through our website for a smoother application process. It’s the best way for us to receive your application and keep track of it. Plus, it shows you’re serious about joining our team!
How to prepare for a job interview at Shell
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure data services like ADLS, ADF, and Databricks. Brush up on your Python, SQL, and Spark skills, as these will likely come up during technical discussions. Being able to demonstrate your expertise with real-time data environments will set you apart.
✨Understand the Business Context
Familiarise yourself with Shell's trading operations and how data acquisition impacts trading, risk, finance, and operations. This knowledge will help you bridge the gap between end-user needs and engineered solutions, showing that you can think strategically about data management.
✨Prepare for Leadership Questions
As a Data Engineering Lead, you’ll need to showcase your leadership experience. Be ready to discuss how you've built high-performing teams, coached team members, and fostered a culture of safety and compliance. Use specific examples to illustrate your approach to team development and project management.
✨Showcase Your Problem-Solving Skills
Expect scenario-based questions where you’ll need to demonstrate your ability to tackle challenges in data ingestion and pipeline building. Prepare to discuss past experiences where you’ve successfully resolved issues related to data quality, lineage, or performance optimisation.
