Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the design and implementation of a cutting-edge data warehousing solution using Databricks.
- Company: Join a forward-thinking company focused on data and analytics innovation.
- Benefits: Competitive salary, hybrid work model, and opportunities for professional growth.
- Why this job: Shape modern data platforms and make a real impact in a strategic project.
- Qualifications: Experience with Azure Databricks, PySpark, and data engineering best practices.
- Other info: Inclusive workplace committed to neurodiversity and equal opportunities.
Are you a skilled Data Engineer looking to step into the world of architecture? An exciting opportunity has opened for an experienced Data Engineer to join our national Data & Analytics function at a time of significant technical modernisation. The team is about to embark on a greenfield project to build a futureproof data warehousing platform using Azure Data Factory and Databricks, with a clear focus on scalability, quality, and best practice.
Working within a specialist Data Platform & Engineering team, you’ll join as the expert within Azure Databricks and PySpark. You will help to upskill our team's knowledge of Databricks, get involved in data modelling and ETL pipeline development, integrations, and performance tuning. This is an ever-evolving project as the business becomes more and more data-driven and your knowledge of Databricks will be pivotal in shaping the architecture.
This is an ideal role for a Lead Data Engineer ready to step into an architectural role, or an established architect keen to take ownership of a highly visible and strategic data platform project.
What you’ll be doing:
- Leading the design and implementation of a new Databricks-based data warehousing solution
- Designing and developing data models, ETL pipelines, and data integration processes
- Large scale data processing using PySpark
- Monitoring, tuning, and optimising data platforms for reliability and performance
- Upskilling the wider team in Databricks best practices, including modern architecture patterns
Location: Atherstone (Hybrid – 3 days office / 2 days remote)
Salary: £60,000 to £80,000 depending on experience
If you’re passionate about shaping modern data platforms and have the technical expertise to make a measurable impact, we’d love to hear from you. Apply now as we have interview slots available!
Please note: Visa sponsorship is not provided for this role and we are only considering applications of candidates who have permanent residency in the UK.
We are an equal opportunity recruitment company. This means we welcome applications from all suitably qualified people regardless of race, sex, disability, religion, sexual orientation or age. We are particularly invested in Neurodiversity inclusion and offer reasonable adjustments in the interview process.
Reasonable adjustments are changes that we can make in the interview process if your disability puts you at a disadvantage compared with others who are not disabled. If you would benefit from a reasonable adjustment in your interview process, please call or email one of our recruiters.
Lead Data Engineer in Atherstone employer: Big Red Recruitment Midlands Limited
Contact Detail:
Big Red Recruitment Midlands Limited Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer in Atherstone
✨Tip Number 1
Get to know the company and its culture before your interview. Research their recent projects, especially in data engineering and analytics, so you can show how your skills align with their goals. This will help us see that you're genuinely interested in being part of the team.
✨Tip Number 2
Prepare to discuss your experience with Azure Databricks and PySpark in detail. We want to hear about specific projects you've worked on, challenges you've faced, and how you overcame them. This is your chance to shine as the expert we’re looking for!
✨Tip Number 3
Practice common interview questions related to data architecture and ETL processes. Think about how you can demonstrate your leadership skills and ability to upskill others, as this role involves mentoring the wider team in best practices.
✨Tip Number 4
Don’t forget to ask insightful questions during your interview! This shows us that you’re engaged and thinking critically about the role. Inquire about the greenfield project and how you can contribute to shaping the future of their data platform.
We think you need these skills to ace Lead Data Engineer in Atherstone
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Lead Data Engineer role. Highlight your experience with Azure Databricks and PySpark, as well as any relevant projects you've worked on. We want to see how your skills align with our exciting greenfield project!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about data engineering and how you can contribute to our team. Be sure to mention your experience in designing data models and ETL pipelines, as this is key for us.
Showcase Your Achievements: Don’t just list your responsibilities; showcase your achievements! Quantify your successes where possible, like improvements in performance or efficiency. This helps us see the impact you've made in previous roles and how you can do the same with us.
Apply Through Our Website: We encourage you to apply through our website for a smoother application process. It’s the best way for us to receive your application directly and ensures you don’t miss out on any important updates from our team!
How to prepare for a job interview at Big Red Recruitment Midlands Limited
✨Know Your Databricks Inside Out
As a Lead Data Engineer, your expertise in Azure Databricks is crucial. Brush up on the latest features and best practices, especially around data modelling and ETL pipeline development. Be ready to discuss how you've used Databricks in past projects and how you can apply that knowledge to the new data warehousing platform.
✨Showcase Your Architectural Vision
This role involves stepping into an architectural position, so be prepared to share your vision for a futureproof data platform. Think about scalability and performance tuning, and be ready to discuss how you would approach designing a robust architecture that meets the business's evolving needs.
✨Prepare for Technical Questions
Expect technical questions that dive deep into your experience with PySpark and large-scale data processing. Review common challenges and solutions you've encountered in previous roles, and be ready to explain your thought process clearly. This will demonstrate your problem-solving skills and technical acumen.
✨Emphasise Team Upskilling
Since part of your role will involve upskilling the team, think about how you can effectively share your knowledge of Databricks. Prepare examples of how you've trained or mentored others in the past, and be ready to discuss your approach to fostering a collaborative learning environment.
