Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the design and build of a modern, scalable data platform using Azure and Databricks.
- Company: Innovative tech company in Sheffield with a hybrid working model.
- Benefits: Up to £85k salary, 5 weeks holiday, stock options, and professional development support.
- Why this job: Shape the future of data architecture while mentoring a talented team.
- Qualifications: Experience in data platforms on Azure and hands-on knowledge of Databricks.
- Other info: Dynamic environment with opportunities for career growth and recognition.
Role: Lead Data Engineer - Azure/Databricks
Location: Sheffield
Working Model: Hybrid - 2 days per week in person
Salary: Up to £85k depending on experience
Own the data platform. Shape the future architecture. This role is for a hands-on data engineering leader who wants to build something properly, not babysit legacy pipelines. You’ll take full ownership of the data engineering domain, leading the design and building of a modern, highly scalable data platform that handles complex, high-frequency industrial data. You’ll work closely with data scientists, software engineers, and senior leadership, with the trust and mandate to make meaningful architectural decisions. If you enjoy balancing strong engineering principles with real-world business needs, and you like mentoring others while staying deeply technical, this role is built for you.
What you’ll be working on:
- Architecting and rebuilding the data transformation layer in Databricks
- Designing robust data flows that support both real-time operational views and deep historical analysis
- Moving pipelines from ad-hoc scripts to software-engineering standards (CI/CD, testing, modular design)
- Defining clear data models, schemas, and standards across a complex data estate
- Establishing a stable, high-performance serving layer for analytics, visualisation, and data science workloads
- Working closely with data scientists to remove bottlenecks and enable better modelling and experimentation
- Pair-programming, mentoring, and raising the engineering bar for a small, capable team
You won’t just be delivering features; you’ll be setting direction.
The tech you’ll work with:
- Core: Azure, Databricks, Python, SQL, dbt, MQTT
- Storage & Serving: Delta Lake, Postgres, TimescaleDB
- Modelling & ML: MLflow, Visualisation: Grafana
What makes you a great fit:
You’re someone who can zoom out to architecture and zoom in to code, comfortably.
- Proven experience building and owning data platforms on Azure
- Deep, hands-on knowledge of Databricks (lakehouse architecture, cluster management, performance and cost optimisation)
- Strong opinions on data modelling, schema design, and standardisation
- You treat data pipelines as software: version control, CI/CD, automated testing. Comfortable challenging architectural decisions, and explaining why
- Able to translate technical trade-offs into business impact for non-technical stakeholders. A mentor by nature: you raise the team through pairing, guidance, and example
Experience with industrial, sensor-driven, or time-series data is highly desirable. Alternatively, a background in high-volume or highly variable data environments (missing data, duplicates, schema drift, spiky load) will transfer well.
Why you’ll want this role:
- You’re trusted to make architectural calls, that’s why you’re being hired
- Your work directly unlocks better analytics and machine learning outcomes.
- You’ll work on advanced data patterns and architectures, not cosmetic refactors. This is a leadership role without stepping away from code
What you’ll get:
- 5 weeks paid holiday plus bank holidays
- Tax-efficient stock options, Company pension scheme, Salary sacrifice EV scheme
- Training and professional development support, regular all-hands sessions with real transparency
- Quarterly employee recognition awards, and access to discounts via BrightHR
We welcome diverse applicants and are dedicated to treating all applicants with dignity and respect, regardless of background.
Lead Data Engineer in Sheffield employer: Rebel Recruitment Limited
Contact Detail:
Rebel Recruitment Limited Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer in Sheffield
✨Tip Number 1
Network like a pro! Reach out to folks in the industry on LinkedIn or at local meetups. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure and Databricks. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Practice explaining complex concepts in simple terms, as you'll need to communicate effectively with both technical and non-technical stakeholders.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search.
We think you need these skills to ace Lead Data Engineer in Sheffield
Some tips for your application 🫡
Tailor Your CV: Make sure your CV speaks directly to the Lead Data Engineer role. Highlight your experience with Azure and Databricks, and don’t forget to showcase any hands-on projects that demonstrate your ability to build scalable data platforms.
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you’re passionate about data engineering and how your skills align with our needs. Mention specific projects or experiences that relate to the job description.
Showcase Your Technical Skills: We want to see your technical prowess! Include relevant programming languages, tools, and methodologies you’ve used in past roles. If you’ve worked with CI/CD or automated testing, make sure to highlight that!
Apply Through Our Website: We encourage you to apply through our website for the best chance of getting noticed. It’s super easy, and you’ll be able to attach all your documents in one go. Plus, we love seeing applications come directly from our site!
How to prepare for a job interview at Rebel Recruitment Limited
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure and Databricks, as these are crucial for the role. Brush up on lakehouse architecture and cluster management, and be ready to discuss how you've optimised performance and costs in past projects.
✨Showcase Your Leadership Skills
This role is about owning the data platform and leading a team. Prepare examples of how you've mentored others or led projects, focusing on how you’ve raised the engineering bar and fostered collaboration among team members.
✨Prepare for Technical Trade-offs
Be ready to discuss architectural decisions and how they impact business outcomes. Think of scenarios where you had to balance technical constraints with business needs, and articulate your thought process clearly.
✨Demonstrate Your Problem-Solving Skills
Expect questions about handling complex data scenarios, like schema drift or high-volume data environments. Prepare to share specific challenges you've faced and how you approached solving them, especially in relation to data pipelines and software engineering standards.
