At a Glance
- Tasks: Lead data acquisition and build Azure-based data pipelines for impactful solutions.
- Company: Join Certain Advantage, a company dedicated to finding the best talent in various sectors.
- Benefits: Competitive contract role with opportunities for career growth and skill development.
- Other info: Onsite role in London with a focus on collaboration and innovation.
- Why this job: Make a real impact in data engineering while leading a dynamic team.
- Qualifications: Expertise in Azure services, Python, SQL, and proven leadership experience required.
The predicted salary is between 80000 - 100000 £ per year.
Certain Advantage are hiring for a Data Engineering Lead based in London. This role is on an initial contract till the end of the year and is required to be onsite 3 days a week. The successful candidate will lead the data acquisition function by defining ingestion strategy and building Azure-based data pipelines. You will translate end-user requirements into scalable engineering solutions, act as the domain’s primary Data Manager for data governance, lineage, quality, and master data management, and lead a team of data engineers in delivering reliable, compliant, and high-value data solutions to Trading, Risk, Finance, and Operations.
Your responsibilities:
- Own ingestion strategy and define scalable batch/streaming data patterns
- Design and deliver Azure-based data pipelines and platform solutions
- Standardize connectors, schemas, controls, CI/CD, IaC, and automated testing
- Lead onboarding of enterprise and market data sources with SLAs and observability
- Partner with Product Owners, Architects, and business stakeholders on data design and governance
- Act as domain Data Manager for lineage, metadata, quality, access, and master data ownership
- Ensure compliance with data lifecycle, audit, records management, and governance standards
- Drive engineering best practices, operational excellence, and continuous improvement
- Manage capacity planning, skills development, and vendor contributions
The individual:
- Expertise in Azure data services (ADLS, ADF, Databricks, Synapse, Event Hub/Kafka), Python, SQL, Spark/PySpark.
- Experience with data modeling, metadata and lineage tooling; performance & cost optimization.
- Proven leadership in engineering teams; Agile/DevOps ways of working; CI/CD; test automation.
- Exposure to energy trading systems (ETRM/Endur), market data (ICE, Platts, Bloomberg), SAP.
- Degree in Computer Science/Engineering or equivalent experience; Azure Data Engineer or Databricks certifications a plus.
Does this sound like your next career move? Apply today.
We go the extra mile to find the best people for the job. If you’re hunting for a role where you can make an impact and grow your career, we’ll work with you to find it. We work with businesses across the UK to find the best people in Finance, Marketing, IT and Engineering. If this job isn’t for you, head to certainadvantage.co.uk and register for job alerts and career guidance tips.
Lead Data Engineer in London employer: Tatton Recruitment Group
Contact Detail:
Tatton Recruitment Group Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer in London
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who’s already in the data engineering field. You never know who might have the inside scoop on job openings or can refer you directly.
✨Show Off Your Skills
Don’t just talk about your experience; showcase it! Create a portfolio of projects that highlight your expertise in Azure data services, Python, and SQL. This will give potential employers a tangible sense of what you can bring to the table.
✨Ace the Interview
Prepare for those interviews by brushing up on common data engineering questions and scenarios. Be ready to discuss your past projects and how you’ve tackled challenges. Remember, confidence is key, so practice makes perfect!
✨Apply Through Our Website
Make sure to apply through our website for the best chance at landing that role! We’re always looking for talented individuals like you, and applying directly helps us keep track of your application and get you in front of the right people faster.
We think you need these skills to ace Lead Data Engineer in London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Lead Data Engineer role. Highlight your experience with Azure data services and any relevant projects you've led. We want to see how your skills match what we're looking for!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for this role. Share specific examples of your leadership in engineering teams and how you've driven best practices in past positions.
Showcase Your Technical Skills: Don’t forget to showcase your technical expertise! Mention your proficiency in Python, SQL, and Spark/PySpark, as well as any certifications you hold. We love seeing candidates who are passionate about their craft.
Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any updates. Let’s get started on this journey together!
How to prepare for a job interview at Tatton Recruitment Group
✨Know Your Azure Inside Out
Make sure you brush up on your knowledge of Azure data services like ADLS, ADF, and Databricks. Be ready to discuss how you've used these tools in past projects, especially in building data pipelines and ingestion strategies.
✨Showcase Your Leadership Skills
As a Lead Data Engineer, you'll be expected to lead a team. Prepare examples of how you've successfully managed teams, driven engineering best practices, and fostered a culture of continuous improvement. Highlight any Agile or DevOps experiences you've had.
✨Understand the Business Context
Familiarise yourself with the sectors that Certain Advantage operates in, such as Trading, Risk, and Finance. Be prepared to discuss how your data solutions can add value to these areas and align with business goals.
✨Prepare for Technical Questions
Expect technical questions around data modelling, SQL, and performance optimisation. Brush up on your Python and Spark skills, and be ready to solve problems on the spot. Practising coding challenges can help you feel more confident.