At a Glance
- Tasks: Lead data acquisition, build pipelines on Azure, and manage a team of data engineers.
- Company: Join Shell, a leader in energy transition and innovation.
- Benefits: Competitive salary, flexible working options, and extensive training opportunities.
- Other info: Diverse and inclusive workplace with a focus on personal growth.
- Why this job: Make a real impact in the energy sector while developing your skills.
- Qualifications: Experience in data engineering and leadership; expertise in Azure services preferred.
The predicted salary is between 80000 - 100000 £ per year.
As a Data Engineering Lead (Data Acquisition), you will lead Shell Energy Trading & Supply’s data acquisition function: own the ingestion strategy and build pipelines on Azure; act as the bridge from end-user needs to engineered solutions; serve as the domain’s go-to Data Manager for mastership, lineage, and quality; and lead a team of data engineers to deliver reliable, compliant, high-value data to Trading, Risk, Finance, and Operations.
What you’ll be doing
- Own the ingestion strategy & build high-quality pipelines: Define target-state patterns for batch/streaming ingestion; standardize connectors, schemas, contracts and controls.
- Lead design and build on Azure data platforms: (ADLS, ADF, Databricks, Synapse, Event Hubs/Kafka), with CI/CD, IaC and automated testing.
- Industrialize onboarding of sources: (ETRM/Endur, Trayport, market data vendors, SAP, SCADA/IoT) with SLAs, observability and runbooks.
- Bridge end‐user requests to engineered solutions: Translate trading desk, risk, operations and finance requirements into a prioritized acquisition backlog; shape epics/stories with clear acceptance criteria.
- Partner with Product Owners, Business Interface and Solution/Data Architects: Align designs, models and mastership decisions for the domain.
- Go‐to Data Manager responsibilities for the domain: Steward data definitions, ownership, lineage, metadata, quality KPIs and access policies; chair data change forums.
- Apply Shell’s technical information & data lifecycle: Register, receive, set up/load, update/maintain, publish/archive or dispose; uphold audit trail and records management.
- Lead and develop a team of Data Engineers: Build a high-performing, inclusive team; coach in coding standards, design reviews, performance tuning and production operations.
- Shape capacity plans, skills roadmap and vendor contributions: Foster a culture of safety, compliance and continuous improvement.
- Operate reliably & safely: Ensure resilience, recoverability and cyber hygiene; meet controls for data privacy, confidentiality and regulatory obligations in trading (e.g., REMIT/EMIR, privacy).
- Drive incident, change & problem management: Measure and report service health and user satisfaction.
What you bring
- Extensive experience in data engineering, with proven years leading teams/products in complex, real‐time data environments.
- Expertise in Azure data services (ADLS, ADF, Databricks, Synapse, Event Hub/Kafka), Python, SQL, Spark/PySpark.
- Strong knowledge of streaming and batch patterns, schema management, CDC, API integration.
- Experience with data modelling, metadata and lineage tooling; performance & cost optimization.
- Proven leadership in engineering teams; Agile/DevOps ways of working; CI/CD; test automation.
- Preferred: exposure to energy trading systems (ETRM/Endur), market data (ICE, Platts, Bloomberg), SAP.
- Degree in Computer Science/Engineering or equivalent experience; Azure Data Engineer or Databricks certifications a plus.
What we offer
- Progress as a person as we work on the energy transition together.
- Continuously grow the transferable skills you need to get ahead.
- Work at the forefront of technology, trends, and practices.
- Collaborate with experienced colleagues with unique expertise.
- Achieve your balance in a values-led culture that encourages you to be the best version of yourself.
- Benefit from a range of flexible working options.
- Perform at your best with a competitive starting salary and annual performance related salary increase.
- Take advantage of paid parental leave, including for non-birthing parents.
- Join an organisation working to become one of the most diverse and inclusive in the world.
- Grow as you progress through diverse career opportunities in national and international teams.
- Gain access to a wide range of training and development programmes.
We are committed to attracting a broader and more diverse pool of candidates. If this position doesn’t feel like the perfect fit for your qualifications right now, we’d still love to hear from you. Shell is working to advance an inclusive, psychologically safe and accessible environment where people with disabilities can excel. If you require any accommodations or accessibility adjustments during the application or interview process, please let us know when prompted in your application.
Data Engineering Lead (Data Acquisition) in London employer: Oman Shell
At Shell, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration. As a Data Engineering Lead in London, you'll not only lead a talented team but also have access to extensive training and development opportunities, competitive salaries, and flexible working options, all while contributing to the vital energy transition. Join us in a values-led environment where diversity and inclusion are at the forefront, allowing you to thrive both personally and professionally.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineering Lead (Data Acquisition) in London
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Tip Number 2
Prepare for those interviews! Research the company, understand their values, and be ready to discuss how your experience aligns with their needs. Practise common interview questions and have your own questions ready to show your interest.
✨Tip Number 3
Showcase your skills! If you’ve got a portfolio or projects that highlight your data engineering expertise, make sure to share them. This is your chance to demonstrate what you can bring to the table beyond just your CV.
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our team at Shell Energy Trading & Supply.
We think you need these skills to ace Data Engineering Lead (Data Acquisition) in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Data Engineering Lead role. Highlight your experience with Azure data services and any leadership roles you've had. We want to see how your skills align with what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about data engineering and how you can contribute to our team. Be sure to mention specific projects or experiences that relate to the job description.
Showcase Your Technical Skills:Don’t forget to showcase your technical skills in your application. Mention your expertise in Python, SQL, and any relevant tools like Databricks or Event Hubs. We love seeing candidates who are hands-on with technology!
Apply Through Our Website:We encourage you to apply through our website for the best chance of being noticed. It’s super easy and ensures your application goes directly to us. Plus, we can’t wait to see what you bring to the table!
How to prepare for a job interview at Oman Shell
✨Know Your Data Engineering Stuff
Make sure you brush up on your data engineering skills, especially with Azure services like ADLS, ADF, and Databricks. Be ready to discuss your experience with batch and streaming ingestion patterns, as well as any relevant projects you've led.
✨Showcase Your Leadership Skills
As a Data Engineering Lead, you'll need to demonstrate your ability to lead a team effectively. Prepare examples of how you've built high-performing teams, coached others, and fostered a culture of continuous improvement in previous roles.
✨Understand the Business Needs
Familiarise yourself with the specific needs of trading, risk, finance, and operations within the energy sector. Be prepared to discuss how you can bridge the gap between end-user requests and engineered solutions, translating complex requirements into actionable plans.
✨Prepare for Technical Questions
Expect technical questions that test your knowledge of data modelling, metadata management, and performance optimisation. Brush up on your SQL and Python skills, and be ready to explain your approach to CI/CD and automated testing in data engineering.
