At a Glance
- Tasks: Design and build cutting-edge Databricks Lakehouse solutions to transform data into actionable insights.
- Company: Join The AA, a beloved brand focused on making data our superpower.
- Benefits: Enjoy competitive salary, annual bonus, and 25 days annual leave.
- Why this job: Be part of a dynamic team modernising data infrastructure and driving meaningful change.
- Qualifications: Significant hands-on experience with Azure Databricks and strong Python skills required.
- Other info: Hybrid working model with opportunities for career growth in a supportive environment.
The predicted salary is between 36000 - 60000 £ per year.
Location: Basingstoke (hybrid working 3 office days per week)
Employment Type: Permanent, full time
Additional Benefits: Annual Bonus
Join Our Data & Analytics Team: Transforming Data into Our Superpower
Are you passionate about data and eager to make a significant impact? The AA is a well-loved brand with a range of driver services much wider than most people realise. We have an enviable set of data assets from breakdown, service, repair, insurance, telematics, digital interactions, car dealers and driving school. We are focused on making Data our new Superpower as one of only 4 strategic priorities for the Group. Our growing team is modernising our data infrastructure to a cutting-edge cloud platform and enabling machine learning and GenAI. Join us at an exciting time and be part of a team that is driving meaningful change for our customers, colleagues and shareholders.
This role is for an experienced Databricks Data Engineer. You will be working day-to-day designing, building and operating production-grade Databricks Lakehouse solutions, including structured streaming pipelines, Unity Catalog governance, and Spark-based data engineering at scale.
This is not a role for someone who has "touched" Databricks occasionally or supported it at the edges. We are looking for someone who has built, owned and evolved Databricks solutions, and who can confidently articulate design decisions, trade-offs, and best practice. If Databricks is central to how you work and can demonstrate this naturally, we want to hear from you.
What will I be doing?
- Designing, building and operating production-grade Databricks Lakehouse solutions, including structured streaming pipelines using Python and PySpark
- Owning and evolving Unity Catalog–based governance, ensuring secure, discoverable and well-managed data assets
- Developing and maintaining event-driven data pipelines, integrating closely with backend engineering teams
- Implementing and supporting CI/CD pipelines in Azure DevOps to enable reliable, automated Databricks deployments
- Creating high-quality, analytics-ready datasets that deliver actionable business insight at scale
- Proactively improving performance, reliability, automation and observability across the Databricks data platform
What do I need?
We are intentionally setting a high bar for Databricks experience. You should be able to demonstrate deep, hands-on capability, not just theoretical knowledge.
Essential experience
- Significant, hands-on experience with Azure Databricks in a production environment
- Proven experience building Spark / Databricks pipelines using Python and PySpark
- Strong experience with structured streaming and event-driven architectures
- Practical experience implementing and operating Unity Catalog
- Solid understanding of Lakehouse design principles, including dimensional and analytical modelling
- Experience building and maintaining CI/CD pipelines, ideally using Azure DevOps
- Confidence working with large-scale data, performance tuning, and troubleshooting complex pipelines
What we mean by "Databricks experience"
You have:
- Designed and built Databricks pipelines end-to-end
- Made architectural decisions within Databricks environments
- Worked with Spark internals, optimisation techniques and cluster configuration
- Operated Databricks solutions in live, business-critical contexts
If your Databricks exposure has been limited to minor contributions, proof-of-concepts, or occasional usage alongside other tools, this role is unlikely to be the right fit.
As a valued member of The AA team, you will have access to a range of benefits including 25 days annual leave plus...
Data Engineer in Basingstoke employer: The Automobile Association
Contact Detail:
The Automobile Association Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineer in Basingstoke
✨Tip Number 1
Network like a pro! Reach out to current employees at The AA on LinkedIn or other platforms. Ask them about their experiences and any tips they might have for landing the Data Engineer role. Personal connections can give you an edge!
✨Tip Number 2
Prepare for the interview by brushing up on your Databricks knowledge. Be ready to discuss your hands-on experience with building pipelines and working with Spark. We want to see your passion for data and how you've made it your superpower!
✨Tip Number 3
Showcase your projects! If you've worked on any relevant Databricks projects, be sure to highlight them during your interview. Bring along examples of your work that demonstrate your skills in structured streaming and event-driven architectures.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, it shows you're genuinely interested in joining our team at The AA and being part of our data transformation journey.
We think you need these skills to ace Data Engineer in Basingstoke
Some tips for your application 🫡
Show Off Your Databricks Skills: Make sure to highlight your hands-on experience with Azure Databricks. We want to see how you've designed and built pipelines, so don’t hold back on the details!
Be Specific About Your Experience: When you describe your past roles, focus on specific projects where you’ve implemented structured streaming or worked with Unity Catalog. This helps us understand your depth of knowledge.
Tailor Your Application: Don’t just send a generic CV! Tailor your application to reflect the skills and experiences that match our job description. It shows us you’re genuinely interested in the role.
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity!
How to prepare for a job interview at The Automobile Association
✨Know Your Databricks Inside Out
Make sure you can confidently discuss your hands-on experience with Databricks. Be ready to share specific examples of how you've designed and built pipelines, made architectural decisions, and optimised performance in a production environment.
✨Showcase Your Problem-Solving Skills
Prepare to talk about complex challenges you've faced while working with data pipelines. Highlight your troubleshooting techniques and how you improved performance or reliability in past projects. This will demonstrate your ability to handle the demands of the role.
✨Understand the Bigger Picture
Familiarise yourself with The AA's mission and how data plays a crucial role in their services. Being able to articulate how your work as a Data Engineer contributes to their goal of transforming data into a superpower will show your alignment with their vision.
✨Ask Insightful Questions
Prepare thoughtful questions about the team, the data infrastructure, and future projects. This not only shows your interest in the role but also gives you a chance to assess if the company culture and goals align with your career aspirations.