At a Glance
- Tasks: Design and build robust data pipelines using cutting-edge tools like Databricks and Spark.
- Company: Join Vivanti, a dynamic tech company shaping the future with data.
- Benefits: Enjoy paid certifications, mentoring, and a supportive growth environment.
- Other info: Participate in hackathons, socials, and continuous learning opportunities.
- Why this job: Make a real impact while working with top brands and innovative technologies.
- Qualifications: 7+ years in Python, Spark, and SQL; experience with Databricks is a plus.
The predicted salary is between 80000 - 100000 ÂŁ per year.
We know you're bringing the skills, the passion and the drive. What we bring is the platform to help you go further. At Vivanti, you're not just taking a job, you're investing in your growth.
Here’s a taste:
- A platform for growth: Work across industries, clients and technologies that stretch your thinking and build your personal and professional skills.
- Access global businesses: Work with some of the world's biggest brands.
- IP, frameworks and accelerators: We share what we know. Our playbooks and toolkits fast-track your success on projects.
- All the shiny tech: Databricks, Snowflake, Azure, GCP, AWS - you’ll use it, play with it and maybe even break it (responsibly).
- Senior consultants who have your back: You’ll always have a guide on your journey, not just be thrown into the deep end.
- Serious learning support: Paid certs, weekly training, guilds, hackathons, mentoring and more.
- Progress that’s transparent: Annual reviews based on 360° feedback, not vague vibes. Clear goals, solid feedback and real growth.
- Kudos and rewards: We celebrate wins, reward impact and offer long-term incentives.
- Real connection: From Friday socials to annual team building days - we work hard and play harder.
We're on the hunt for people who love solving problems, thinking critically and staying curious. If you’ve worked in data or tech before - amazing. If you’ve got a brain that enjoys untangling complex stuff and applying what you’ve learned - even better!
We're less about ticking boxes and more about whether you'd thrive in this environment:
- Do you get excited about helping clients move forward?
- Do you want to lead technical strategy while remaining hands-on with the code?
- Are you keen to experiment with the latest tools and ideas?
- Can you balance driving high-level architecture and being a great teammate?
If you said “yes” more than once, let’s talk.
We’re open to people at different experience levels and career stages. Here's a sense of what you'll do and the tools you might use:
As the Principal Data Engineer, you’re the architect and the expert—defining how complex data ecosystems are built and scaled.
What you'll do:
- Designing and building robust data pipelines using Databricks, Spark, and Delta Lake
- Implementing scalable and secure Lakehouse architectures on Databricks
- Collaborating with analysts, ML engineers, and platform teams to deliver Databricks-native solutions
- Applying best practices in data governance, CI/CD, and orchestration within the Databricks ecosystem
- Ensuring systems are secure, reliable and cost-effective
What you will bring:
- 7+ years of experience in Python, Spark, and SQL for building scalable data pipelines in Databricks
- Deep experience with Databricks features including Delta Lake, Unity Catalog, and MLflow
- Workflow orchestration using Airflow or Databricks Workflows
- Integration experience with dbt, Fivetran, and Terraform for modern data stack automation
- Familiarity with cloud platforms (Azure, AWS, GCP)
- Knowledge and experience of data modelling techniques (Inmon, Data Vault, Kimball)
- Knowledge and experience of the data lifecycle, data management & governance, data platform architectures
- Knowledge and experience of Databricks data pipeline & data platform optimisation techniques
Your work matters and so do you. That’s why we back your skills with a structure that supports your development, celebrates your wins, and helps you keep growing - professionally and personally.
Here’s what’s waiting for you:
- Kudos & Recognition Programs – great work doesn’t go unnoticed
- Mentoring Program – with a Senior Support Lead
- 360° Progress Reviews – honest feedback, not fluff
- Guilds & Regular Training – learn from your peers
- Paid Certifications – across all major technologies
- Hackathons & Innovation Days – challenge yourself, build cool stuff
- Socials & Team Days – Book Club, Data & Drinks, Team Building days, and more
If you're looking for the place where your growth will go into overdrive, where you'll work with great humans, get access to cutting-edge tools and genuinely enjoy the ride? Welcome to Vivanti.
The Data People Shaping Tomorrow
Vivanti was founded as a haven for talented technologists who want to make a real impact for their clients. Our mission is to transform businesses and to create a smarter, more connected world through the power of data and technology. Together, we are making the future happen - today.
Principal Data Engineer (Databricks) in London employer: Vivanti Consulting
Contact Detail:
Vivanti Consulting Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Principal Data Engineer (Databricks) in London
✨Tip Number 1
Network like a pro! Get out there and connect with folks in the industry. Attend meetups, webinars, or even just grab a coffee with someone who’s already in the game. You never know who might have the inside scoop on job openings!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Databricks, Spark, or any cool data pipelines you've built. This is your chance to shine and demonstrate what you can bring to the table.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Practice common interview questions and think about how you can relate your experience to the role of Principal Data Engineer. Confidence is key!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, it shows you’re genuinely interested in joining our team at Vivanti. Let’s make this happen!
We think you need these skills to ace Principal Data Engineer (Databricks) in London
Some tips for your application 🫡
Show Your Passion: When you're writing your application, let your enthusiasm for data engineering shine through! We want to see how excited you are about solving complex problems and using cutting-edge tech like Databricks.
Tailor Your CV: Make sure your CV reflects the skills and experiences that match what we're looking for. Highlight your experience with Python, Spark, and any relevant projects you've worked on. We love seeing how you've tackled challenges in the past!
Craft a Compelling Cover Letter: Your cover letter is your chance to tell us why you're the perfect fit for the role. Share specific examples of your work and how it aligns with our mission at Vivanti. We want to know how you can help our clients move forward!
Apply Through Our Website: Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re serious about joining our team!
How to prepare for a job interview at Vivanti Consulting
✨Know Your Tech Inside Out
Make sure you’re well-versed in Databricks, Spark, and Delta Lake. Brush up on your Python and SQL skills, and be ready to discuss how you've implemented scalable data pipelines in the past. The more specific examples you can provide, the better!
✨Showcase Your Problem-Solving Skills
Prepare to share instances where you've tackled complex data challenges. Think about how you approached the problem, the tools you used, and the impact of your solution. This will demonstrate your critical thinking and ability to thrive in a dynamic environment.
✨Collaborate Like a Pro
Since the role involves working with analysts and ML engineers, be ready to discuss your experience in cross-functional teams. Highlight any collaborative projects you've worked on and how you contributed to achieving common goals. Teamwork is key!
✨Ask Insightful Questions
Prepare thoughtful questions about the company culture, growth opportunities, and the technologies they use. This shows your genuine interest in the role and helps you assess if it’s the right fit for you. Plus, it makes for a great conversation starter!