Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead data acquisition and build Azure-based data pipelines for impactful solutions.
- Company: Join Certain Advantage, a company dedicated to finding the best talent in various sectors.
- Benefits: Competitive pay, career growth opportunities, and a chance to make a real impact.
- Other info: Dynamic role with opportunities for continuous improvement and professional development.
- Why this job: Shape the future of data engineering while working with cutting-edge technologies.
- Qualifications: Expertise in Azure services, Python, SQL, and proven leadership skills required.
The predicted salary is between 70000 - 90000 £ per year.
Certain Advantage are hiring for a Data Engineering Lead based in London. This role is on an initial contract till the end of the year and is required to be onsite 3 days a week.
The successful candidate will lead the data acquisition function by defining ingestion strategy and building Azure-based data pipelines. You will translate end-user requirements into scalable engineering solutions, act as the domain’s primary Data Manager for data governance, lineage, quality, and master data management, and lead a team of data engineers in delivering reliable, compliant, and high-value data solutions to Trading, Risk, Finance, and Operations.
Your responsibilities:
- Own ingestion strategy and define scalable batch/streaming data patterns
- Design and deliver Azure-based data pipelines and platform solutions
- Standardize connectors, schemas, controls, CI/CD, IaC, and automated testing
- Lead onboarding of enterprise and market data sources with SLAs and observability
- Partner with Product Owners, Architects, and business stakeholders on data design and governance
- Act as domain Data Manager for lineage, metadata, quality, access, and master data ownership
- Ensure compliance with data lifecycle, audit, records management, and governance standards
- Drive engineering best practices, operational excellence, and continuous improvement
- Manage capacity planning, skills development, and vendor contributions
The individual:
- Expertise in Azure data services (ADLS, ADF, Databricks, Synapse, Event Hub/Kafka), Python, SQL, Spark/PySpark.
- Experience with data modeling, metadata and lineage tooling; performance & cost optimization.
- Proven leadership in engineering teams; Agile/DevOps ways of working; CI/CD; test automation.
- Exposure to energy trading systems (ETRM/Endur), market data (ICE, Platts, Bloomberg), SAP.
- Degree in Computer Science/Engineering or equivalent experience; Azure Data Engineer or Databricks certifications a plus.
Does this sound like your next career move? Apply today.
We go the extra mile to find the best people for the job. If you’re hunting for a role where you can make an impact and grow your career, we’ll work with you to find it.
We work with businesses across the UK to find the best people in Finance, Marketing, IT and Engineering. If this job isn’t for you, head to (url removed) and register for job alerts and career guidance tips.
Data Engineering Lead in South Bank employer: Tatton Recruitment
Contact Detail:
Tatton Recruitment Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineering Lead in South Bank
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field, especially those who work with Azure. A friendly chat can lead to insider info about job openings or even referrals.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your best projects, especially those involving Azure data services and Python. This will give potential employers a taste of what you can bring to the table.
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering scenarios. Be ready to discuss how you've tackled challenges in ingestion strategies or data governance. We want to see your problem-solving skills in action!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we’re always looking for passionate individuals who want to make an impact in their careers.
We think you need these skills to ace Data Engineering Lead in South Bank
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Data Engineering Lead role. Highlight your experience with Azure data services and any relevant projects you've led. We want to see how your skills match what we're looking for!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for this role. Mention specific experiences that relate to data governance and engineering best practices, as these are key for us.
Showcase Your Leadership Skills: Since this role involves leading a team, make sure to highlight your leadership experience. Share examples of how you've successfully managed teams or projects in the past, especially in Agile/DevOps environments.
Apply Through Our Website: We encourage you to apply directly through our website. It’s the easiest way for us to keep track of your application and ensures you don’t miss out on any updates. Plus, we love seeing applications come in through our platform!
How to prepare for a job interview at Tatton Recruitment
✨Know Your Azure Inside Out
Make sure you brush up on your knowledge of Azure data services like ADLS, ADF, and Databricks. Be ready to discuss how you've used these tools in past projects, as well as any challenges you faced and how you overcame them.
✨Showcase Your Leadership Skills
Since this role involves leading a team, be prepared to share examples of your leadership experience. Talk about how you've managed teams, driven engineering best practices, and fostered a culture of continuous improvement.
✨Understand the Business Context
Familiarise yourself with the sectors that Certain Advantage operates in, especially Trading, Risk, Finance, and Operations. Being able to connect your technical skills to business outcomes will set you apart from other candidates.
✨Prepare for Technical Questions
Expect to dive deep into technical discussions around data ingestion strategies, CI/CD processes, and data governance. Practise explaining complex concepts in simple terms, as you'll need to communicate effectively with both technical and non-technical stakeholders.