At a Glance
- Tasks: Lead the development of a modern Databricks Lakehouse environment and drive engineering best practices.
- Company: A well-established organisation with a people-first culture and a focus on innovation.
- Benefits: Competitive salary, comprehensive benefits, flexible remote work, and a 35-hour week.
- Why this job: Shape platform strategy and contribute to exciting AI and automation initiatives.
- Qualifications: Strong experience in Azure, Databricks, and DevOps practices.
- Other info: Join a collaborative team that values autonomy and continuous improvement.
The predicted salary is between 80000 - 85000 £ per year.
This is an opportunity to step into a highly influential Data Platform Engineering role where you will shape, optimise and own a modern Databricks Lakehouse environment. You will play a key role in driving engineering best practice, improving automation and enabling scalable data solutions across a growing data function.
The Company
They are a large, well‑established organisation known for combining deep technical expertise with a people‑first culture. With a nationwide presence and a modern approach to flexible working, they invest heavily in technology, innovation and colleague development. Their data function is expanding and plays a central role in supporting transformation, decision‑making and future AI initiatives. You will join a collaborative team that values engineering excellence, autonomy and continuous improvement.
The Role
As Lead Data Platform Engineer, you will:
- Develop and deploy Databricks Lakehouse platform solutions within Azure.
- Build and maintain automation for clusters, tagging, monitoring and platform operations.
- Architect and design end‑to‑end data platform solutions focused on scalability, security and reliability.
- Lead delivery using Databricks, PySpark, Spark SQL and Azure Data Factory.
- Drive DevOps best practices including CI/CD, automated testing and infrastructure as code.
- Collaborate closely with data engineers, ML engineers and wider technical teams to deliver robust platform capabilities.
- Take ownership of key data platform projects and influence engineering direction.
- Provide technical leadership and ensure standards, patterns and best practices are followed.
Your Skills and Experience
You will bring:
- Strong commercial experience in Azure and Databricks, with deep knowledge of Lakehouse architecture.
- Proficiency in PySpark, Python, SQL and Spark SQL.
- Strong DevOps engineering skills including CI/CD, automated testing and deployment pipelines.
- Experience with monitoring, logging and alerting solutions.
- Ability to design, build and optimise cloud platform solutions.
- Stakeholder management skills and confidence working across multiple teams.
- API development experience.
- Azure Data Factory knowledge is beneficial.
What They Offer
- Salary between £80,000 and £85,000 plus bonus.
- Comprehensive benefits package and annual pay review.
- Flexible by choice working environment with remote‑first culture.
- 35‑hour working week promoting genuine work‑life balance.
- Opportunities to shape platform strategy and contribute to future AI and automation initiatives.
How to Apply
If you are a strong Data Platform Engineer with deep Databricks expertise and want to take ownership of a modern Azure Lakehouse environment, please apply today.
Lead Data Platform Engineer in Doncaster employer: Harnham
Contact Detail:
Harnham Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Platform Engineer in Doncaster
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field and let them know you're on the lookout for opportunities. You never know who might have a lead or can put in a good word for you.
✨Tip Number 2
Get involved in online communities! Join forums, LinkedIn groups, or even Discord channels related to data engineering. Engaging with others in the field can help you learn about job openings and get insider tips.
✨Tip Number 3
Showcase your skills! Create a portfolio or GitHub repository with projects that highlight your expertise in Azure, Databricks, and DevOps practices. This will give potential employers a taste of what you can bring to the table.
✨Tip Number 4
Apply through our website! We love seeing passionate candidates who are eager to join our team. Make sure to tailor your application to highlight your experience with Databricks and cloud solutions to stand out.
We think you need these skills to ace Lead Data Platform Engineer in Doncaster
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience with Azure and Databricks. We want to see how you've shaped data platforms in the past, so don’t hold back on those details!
Showcase Your Skills: When writing your application, emphasise your proficiency in PySpark, SQL, and DevOps practices. We’re looking for someone who can lead and innovate, so let us know how you’ve done that before!
Be Authentic: Don’t be afraid to show a bit of personality in your application. We value a people-first culture, so being genuine about your experiences and motivations will help you stand out.
Apply Through Our Website: For the best chance of success, make sure to apply directly through our website. It’s the easiest way for us to see your application and get you into the process!
How to prepare for a job interview at Harnham
✨Know Your Databricks Inside Out
Make sure you brush up on your Databricks knowledge before the interview. Be ready to discuss your experience with Lakehouse architecture and how you've implemented it in past projects. This will show that you’re not just familiar with the technology, but that you can also leverage it effectively.
✨Showcase Your DevOps Skills
Since this role emphasises DevOps best practices, be prepared to talk about your experience with CI/CD, automated testing, and infrastructure as code. Bring examples of how you've improved automation in previous roles, as this will demonstrate your ability to drive engineering excellence.
✨Collaboration is Key
Highlight your experience working with cross-functional teams, especially data engineers and ML engineers. Share specific instances where your collaboration led to successful project outcomes. This will illustrate your ability to work within a team and influence engineering direction.
✨Prepare Questions About Their Culture
Since the company values a people-first culture, come prepared with questions that reflect your interest in their work environment. Ask about their approach to colleague development and how they support innovation. This shows that you’re not just interested in the role, but also in being part of their community.