At a Glance
- Tasks: Lead data acquisition and build Azure-based data pipelines for high-value solutions.
- Company: Certain Advantage, a leading recruitment firm in the UK.
- Benefits: Competitive contract rate, onsite collaboration, and opportunities for professional growth.
- Other info: Join a collaborative team and enhance your skills in a fast-paced industry.
- Why this job: Make a real impact by leading innovative data engineering projects in a dynamic environment.
- Qualifications: Experience in Azure data services, Python, SQL, and team leadership.
The predicted salary is between 70000 - 90000 £ per year.
Certain Advantage are hiring for a Data Engineering Lead based in London. This role is on an initial contract till the end of the year and is required to be onsite 3 days a week.
The successful candidate will lead the data acquisition function by defining ingestion strategy and building Azure-based data pipelines. You will translate end-user requirements into scalable engineering solutions, act as the domain’s primary Data Manager for data governance, lineage, quality, and master data management, and lead a team of data engineers in delivering reliable, compliant, and high-value data solutions to Trading, Risk, Finance, and Operations.
- Own ingestion strategy and define scalable batch/streaming data patterns
- Design and deliver Azure-based data pipelines and platform solutions
- Standardize connectors, schemas, controls, CI/CD, IaC, and automated testing
- Lead onboarding of enterprise and market data sources with SLAs and observability
- Partner with Product Owners, Architects, and business stakeholders on data design and governance
- Act as domain Data Manager for lineage, metadata, quality, access, and master data ownership
- Ensure compliance with data lifecycle, audit, records management, and governance standards
Expertise in Azure data services (ADLS, ADF, Databricks, Synapse, Event Hub/Kafka), Python, SQL, Spark/PySpark. Experience with data modeling, metadata and lineage tooling; performance & cost optimization. Agile/DevOps ways of working; Exposure to energy trading systems (ETRM/Endur), market data (ICE, Platts, Bloomberg), SAP.
Degree in Computer Science/Engineering or equivalent experience; Azure Data Engineer or Databricks certifications a plus.
Lead Engineer/Data Engineer in London employer: Tatton Recruitment Group
Contact Detail:
Tatton Recruitment Group Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Engineer/Data Engineer in London
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who work in data engineering. A friendly chat can lead to insider info about job openings or even referrals that could give you an edge.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your Azure-based data pipelines and any projects you've led. This is your chance to demonstrate your expertise in data governance and engineering solutions, so make it shine!
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering scenarios. Be ready to discuss how you've tackled challenges in ingestion strategies or data quality management. We want to see your problem-solving skills in action!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to stay updated on new opportunities and get tailored career guidance. Plus, we’re here to help you every step of the way in landing that dream role!
We think you need these skills to ace Lead Engineer/Data Engineer in London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Lead Engineer/Data Engineer role. Highlight your experience with Azure data services and any relevant projects you've worked on. We want to see how your skills align with our needs!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for this role. Mention specific experiences that relate to data governance, ingestion strategies, and leading teams. Let us know what makes you tick!
Showcase Your Technical Skills: Don’t forget to showcase your technical skills in Python, SQL, and Spark/PySpark. We’re looking for someone who can hit the ground running, so make sure we can see your expertise clearly in your application.
Apply Through Our Website: We encourage you to apply through our website for the best chance of getting noticed. It’s super easy, and you’ll be able to keep track of your application status. Plus, we love seeing applications come directly from our site!
How to prepare for a job interview at Tatton Recruitment Group
✨Know Your Azure Inside Out
Make sure you brush up on your knowledge of Azure data services like ADLS, ADF, and Databricks. Be ready to discuss how you've used these tools in past projects, as well as any challenges you faced and how you overcame them.
✨Showcase Your Leadership Skills
As a Lead Engineer, you'll be expected to lead a team. Prepare examples of how you've successfully managed teams in the past, focusing on your approach to mentoring, conflict resolution, and driving project success.
✨Understand Data Governance
Familiarise yourself with data governance principles, especially around lineage, quality, and compliance. Be prepared to discuss how you've implemented these in previous roles and how you would approach them in this new position.
✨Prepare for Technical Questions
Expect technical questions related to data ingestion strategies, batch/streaming patterns, and CI/CD practices. Brush up on your Python, SQL, and Spark skills, and be ready to solve problems on the spot or explain your thought process clearly.