At a Glance
- Tasks: Lead data engineering projects, solve complex problems, and deliver production-grade solutions.
- Company: Join a forward-thinking team at the intersection of data and AI.
- Benefits: Competitive pay, flexible contract terms, and the chance to work with cutting-edge technology.
- Why this job: Shape the future of data engineering while mentoring others in a dynamic environment.
- Qualifications: 7+ years in data engineering with strong skills in Spark, ADF, Python/Scala, and cloud technologies.
- Other info: This role is ideal for proactive individuals who thrive on defining their work.
We're looking for a hands-on, technically heavyweight Lead Data Engineer to step into a high-impact contract role — shaping both the technical direction and the way the team works. This isn't a ticket-taking role. You'll lead from the front: spotting the problems worth solving, identifying better tools or patterns, and delivering well-justified, production-grade solutions.
We're working at the intersection of data and AI, solving both greenfield and brownfield challenges with modern cloud tooling.
You’ll need:
- 7+ years in data engineering
- Spark, ADF, Python/Scala – solid hands-on skills
- Cloud-first thinking (Azure preferred, but AWS/GCP welcome)
- Experience designing end-to-end pipelines at scale
- A commercial mindset – you think in terms of business value and cost
- AI/ML awareness — you’ve worked alongside data scientists
- A pragmatic, fail-fast, iterate-forward attitude
- Confidence to lead, influence, and mentor
If you're the kind of contractor who doesn't just do the work, but defines it — let's talk.
Contact Detail:
Nicoll Curtin Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineer (London Area)
✨Tip Number 1
Network with professionals in the data engineering field, especially those who have experience with Azure and Python/Scala. Attend meetups or webinars to connect with potential colleagues and learn about the latest trends and tools in the industry.
✨Tip Number 2
Showcase your hands-on experience by contributing to open-source projects related to data engineering. This not only demonstrates your technical skills but also your ability to collaborate and lead within a team setting.
✨Tip Number 3
Prepare to discuss specific examples of how you've designed end-to-end data pipelines at scale. Be ready to explain the challenges you faced and how you overcame them, as this will highlight your problem-solving abilities.
✨Tip Number 4
Familiarise yourself with the latest AI and ML trends, as well as how they intersect with data engineering. Being able to speak knowledgeably about these topics will set you apart and show that you understand the broader context of your role.
We think you need these skills to ace Data Engineer (London Area)
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your 7+ years of experience in data engineering, specifically mentioning your hands-on skills with Spark, ADF, Python, and Scala. Use keywords from the job description to ensure it aligns with what the company is looking for.
Craft a Compelling Cover Letter: In your cover letter, emphasise your cloud-first thinking and experience with Azure, AWS, or GCP. Discuss specific projects where you designed end-to-end pipelines at scale and how they delivered business value.
Showcase Leadership Skills: Since this role requires leading and mentoring, include examples of how you've influenced teams or projects in the past. Highlight your pragmatic approach to problem-solving and your ability to iterate quickly.
Demonstrate AI/ML Awareness: Mention any collaborations with data scientists or projects that involved AI/ML. This will show that you understand the intersection of data and AI, which is crucial for this position.
How to prepare for a job interview at Nicoll Curtin
✨Showcase Your Technical Skills
Be prepared to discuss your hands-on experience with Spark, ADF, Python, and Scala. Bring examples of projects where you've designed end-to-end data pipelines and be ready to explain the challenges you faced and how you overcame them.
✨Demonstrate Cloud Knowledge
Since the role prefers Azure but welcomes AWS and GCP, brush up on your cloud-first thinking. Be ready to discuss how you've leveraged cloud technologies in previous roles and how they can enhance data engineering processes.
✨Emphasise Your Leadership Qualities
This position requires a confident leader who can mentor others. Prepare to share instances where you've led a team or project, highlighting your ability to influence and guide others towards achieving common goals.
✨Think Business Value
The company is looking for someone with a commercial mindset. Be ready to discuss how your technical decisions have positively impacted business outcomes, demonstrating that you understand the importance of aligning data engineering efforts with business objectives.