Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the design and build of a modern, scalable data platform using Azure and Databricks.
- Company: Innovative tech company in Sheffield with a focus on data engineering.
- Benefits: Up to £85k salary, 5 weeks holiday, stock options, and professional development support.
- Why this job: Make impactful architectural decisions and work on advanced data challenges.
- Qualifications: Experience in data platforms, Azure, and Databricks; mentoring skills are a plus.
- Other info: Hybrid working model with a dynamic team and opportunities for growth.
Location: Sheffield
Working Model: Hybrid - 2 days per week in person
Salary: Up to £85k depending on experience
Own the data platform. Shape the future architecture. This role is for a hands-on data engineering leader who wants to build something properly, not babysit legacy pipelines. You will take full ownership of the data engineering domain, leading the design and building of a modern, highly scalable data platform that handles complex, high-frequency industrial data. You will work closely with data scientists, software engineers, and senior leadership, with the trust and mandate to make meaningful architectural decisions.
If you enjoy balancing strong engineering principles with real-world business needs, and you like mentoring others while staying deeply technical, this role is built for you.
What you will be working on:
- Architecting and rebuilding the data transformation layer in Databricks
- Designing robust data flows that support both real-time operational views and deep historical analysis
- Moving pipelines from ad-hoc scripts to software-engineering standards (CI/CD, testing, modular design)
- Defining clear data models, schemas, and standards across a complex data estate
- Establishing a stable, high-performance serving layer for analytics, visualisation, and data science workloads
- Working closely with data scientists to remove bottlenecks and enable better modelling and experimentation
- Pair-programming, mentoring, and raising the engineering bar for a small, capable team
You won’t just be delivering features; you’ll be setting direction.
The tech you will work with:
- Core: Azure, Databricks, Python, SQL, dbt, MQTT
- Storage & Serving: Delta Lake, Postgres, TimescaleDB
- Modelling & ML: MLflow
- Visualisation: Grafana
What makes you a great fit:
- You are someone who can zoom out to architecture and zoom in to code, comfortably.
- Proven experience building and owning data platforms on Azure
- Deep, hands-on knowledge of Databricks (lakehouse architecture, cluster management, performance and cost optimisation)
- Strong opinions on data modelling, schema design, and standardisation
- You treat data pipelines as software: version control, CI/CD, automated testing
- Comfortable challenging architectural decisions, and explaining why
- Able to translate technical trade-offs into business impact for non-technical stakeholders
- A mentor by nature: you raise the team through pairing, guidance, and example
Industry experience:
- Experience with industrial, sensor-driven, or time-series data is highly desirable
- Alternatively, background in high-volume or highly variable data environments (missing data, duplicates, schema drift, spiky load) will transfer well
Why you will want this role:
- Real autonomy: You’re trusted to make architectural calls, that’s why you’re being hired
- Visible impact: Your work directly unlocks better analytics and machine learning outcomes
- Modern problems: You’ll work on advanced data patterns and architectures, not cosmetic refactors
- Still technical: This is a leadership role without stepping away from code
What you will get:
- 5 weeks paid holiday plus bank holidays
- Tax-efficient stock options
- Company pension scheme
- Salary sacrifice EV scheme
- Training and professional development support
- Regular all-hands sessions with real transparency
- Hybrid working (2 days in person)
- Quarterly employee recognition awards
- Access to discounts via BrightHR
We welcome diverse applicants and are dedicated to treating all applicants with dignity and respect, regardless of background.
Lead Data Engineer in Sheffield employer: Rebel Recruitment
Contact Detail:
Rebel Recruitment Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer in Sheffield
✨Tip Number 1
Network like a pro! Get out there and connect with folks in the data engineering space. Attend meetups, webinars, or even local tech events. You never know who might have the inside scoop on job openings or can refer you directly to hiring managers.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure and Databricks. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Be ready to discuss your experience with data platforms and how you've tackled real-world problems. Practice common interview questions and scenarios related to data engineering.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we love seeing candidates who are proactive about their job search. So, get that application in and let’s make some data magic happen!
We think you need these skills to ace Lead Data Engineer in Sheffield
Some tips for your application 🫡
Tailor Your CV: Make sure your CV speaks directly to the Lead Data Engineer role. Highlight your experience with Azure and Databricks, and don’t forget to showcase any hands-on projects that demonstrate your ability to build scalable data platforms.
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you’re passionate about data engineering and how your skills align with our needs. Mention specific projects or experiences that relate to the job description.
Showcase Your Technical Skills: We want to see your technical prowess! Include relevant programming languages, tools, and methodologies you’ve used in past roles. If you’ve worked on CI/CD processes or data modelling, make sure to highlight those experiences.
Apply Through Our Website: Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining the StudySmarter team!
How to prepare for a job interview at Rebel Recruitment
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure and Databricks, as these are crucial for the role. Brush up on your knowledge of lakehouse architecture and cluster management, and be ready to discuss how you've optimised performance and costs in past projects.
✨Showcase Your Leadership Skills
This role is all about leading a team and making architectural decisions. Prepare examples of how you've mentored others and raised the engineering bar in previous positions. Highlight your ability to balance technical depth with business needs.
✨Prepare for Technical Challenges
Expect to dive deep into data modelling and schema design during the interview. Be ready to discuss how you treat data pipelines as software, including your experience with version control, CI/CD, and automated testing. Real-world examples will help illustrate your points.
✨Communicate Clearly with Non-Tech Stakeholders
You’ll need to explain complex technical trade-offs to non-technical stakeholders. Practice articulating your thought process and the business impact of your architectural decisions. This will show that you can bridge the gap between tech and business effectively.
