Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the design and build of a modern, scalable data platform using Azure and Databricks.
- Company: Innovative tech company in Sheffield with a focus on data engineering.
- Benefits: Up to £85k salary, 5 weeks holiday, stock options, and professional development support.
- Why this job: Make impactful architectural decisions and work on advanced data challenges.
- Qualifications: Proven experience in data platforms, Azure, and Databricks; mentoring skills are a plus.
- Other info: Hybrid working model with a dynamic team and opportunities for career growth.
The predicted salary is between 68000 - 102000 £ per year.
Location: Sheffield
Working Model: Hybrid - 2 days per week in person
Salary: Up to £85k depending on experience
Own the data platform. Shape the future architecture. This role is for a hands-on data engineering leader who wants to build something properly, not babysit legacy pipelines. You will take full ownership of the data engineering domain, leading the design and building of a modern, highly scalable data platform that handles complex, high-frequency industrial data. You will work closely with data scientists, software engineers, and senior leadership, with the trust and mandate to make meaningful architectural decisions. If you enjoy balancing strong engineering principles with real-world business needs, and you like mentoring others while staying deeply technical, this role is built for you.
What you will be working on:
- Architecting and rebuilding the data transformation layer in Databricks
- Designing robust data flows that support both real-time operational views and deep historical analysis
- Moving pipelines from ad-hoc scripts to software-engineering standards (CI/CD, testing, modular design)
- Defining clear data models, schemas, and standards across a complex data estate
- Establishing a stable, high-performance serving layer for analytics, visualisation, and data science workloads
- Working closely with data scientists to remove bottlenecks and enable better modelling and experimentation
- Pair-programming, mentoring, and raising the engineering bar for a small, capable team
You won’t just be delivering features; you’ll be setting direction.
The tech you will work with:
- Core: Azure, Databricks, Python, SQL, dbt, MQTT
- Storage & Serving: Delta Lake, Postgres, TimescaleDB
- Modelling & ML: MLflow
- Visualisation: Grafana
What makes you a great fit:
- You’re someone who can zoom out to architecture and zoom in to code, comfortably.
- Proven experience building and owning data platforms on Azure
- Deep, hands-on knowledge of Databricks (lakehouse architecture, cluster management, performance and cost optimisation)
- Strong opinions on data modelling, schema design, and standardisation
- You treat data pipelines as software: version control, CI/CD, automated testing
- Comfortable challenging architectural decisions, and explaining why
- Able to translate technical trade-offs into business impact for non-technical stakeholders
- A mentor by nature: you raise the team through pairing, guidance, and example
Industry experience:
- Experience with industrial, sensor-driven, or time-series data is highly desirable
- Alternatively, background in high-volume or highly variable data environments (missing data, duplicates, schema drift, spiky load) will transfer well
Why you will want this role:
- Real autonomy: You’re trusted to make architectural calls, that’s why you’re being hired
- Visible impact: Your work directly unlocks better analytics and machine learning outcomes
- Modern problems: You’ll work on advanced data patterns and architectures, not cosmetic refactors
- Still technical: This is a leadership role without stepping away from code
What you will get:
- 5 weeks paid holiday plus bank holidays
- Tax-efficient stock options
- Company pension scheme
- Salary sacrifice EV scheme
- Training and professional development support
- Regular all-hands sessions with real transparency
- Hybrid working (2 days in person)
- Quarterly employee recognition awards
- Access to discounts via BrightHR
We welcome diverse applicants and are dedicated to treating all applicants with dignity and respect, regardless of background.
Locations
Lead Data Engineer in Sheffield, Yorkshire employer: Rebel Recruitment
Contact Detail:
Rebel Recruitment Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer in Sheffield, Yorkshire
✨Tip Number 1
Network like a pro! Get out there and connect with folks in the data engineering scene. Attend meetups, webinars, or even just grab a coffee with someone in the industry. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure and Databricks. This is your chance to demonstrate your hands-on experience and architectural prowess. Make sure to highlight any complex data platforms you've built or contributed to.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Be ready to discuss your approach to data modelling and how you tackle real-world problems. Practice explaining technical concepts in a way that non-technical stakeholders can understand – it’s a key part of the role!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search. So, get your application in and let’s build something amazing together!
We think you need these skills to ace Lead Data Engineer in Sheffield, Yorkshire
Some tips for your application 🫡
Tailor Your CV: Make sure your CV speaks directly to the Lead Data Engineer role. Highlight your experience with Azure and Databricks, and don’t forget to showcase any hands-on projects that demonstrate your ability to own a data platform.
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you’re passionate about building modern data architectures and how your skills align with our needs. Keep it conversational but professional.
Showcase Your Technical Skills: In your application, be specific about your technical expertise. Mention your experience with CI/CD, data modelling, and any relevant tools like Python and SQL. We want to see how you can contribute to our team!
Apply Through Our Website: We encourage you to apply through our website for the best chance of getting noticed. It’s the easiest way for us to keep track of your application and ensure it reaches the right people!
How to prepare for a job interview at Rebel Recruitment
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure and Databricks, as these are crucial for the role. Brush up on lakehouse architecture, cluster management, and performance optimisation. Being able to discuss your hands-on experience with these technologies will show that you’re not just a theorist but someone who can get things done.
✨Showcase Your Leadership Skills
This role is about owning the data platform and leading a team. Be prepared to share examples of how you've mentored others or led projects in the past. Highlight your ability to balance technical work with guiding a team, as this will demonstrate that you can set direction while still being deeply involved in the code.
✨Prepare for Architectural Discussions
Expect questions about architectural decisions and trade-offs. Think about how you would explain complex technical concepts to non-technical stakeholders. Practising how to articulate the business impact of your technical choices will help you stand out as a candidate who can bridge the gap between tech and business needs.
✨Demonstrate Problem-Solving Skills
Be ready to discuss how you've tackled challenges in data engineering, especially in high-volume or time-series environments. Prepare specific examples where you’ve moved pipelines from ad-hoc scripts to more robust solutions, showcasing your understanding of CI/CD and automated testing. This will illustrate your capability to handle real-world problems effectively.
