Senior Databricks Engineer

Senior Databricks Engineer

Freelance 80000 - 100000 £ / year (est.) Home office (partial)
Opus Recruitment Solutions Ltd

At a Glance

  • Tasks: Design and optimise data pipelines using Azure, Databricks, Python, and SQL.
  • Company: Join a dynamic team focused on building a modern cloud-based data platform.
  • Benefits: Competitive pay, hybrid work model, and opportunities for professional growth.
  • Other info: Work in a collaborative environment with a focus on data quality and governance.
  • Why this job: Make a real impact by delivering scalable data solutions for analytics and reporting.
  • Qualifications: Experience with Databricks, Azure platforms, advanced SQL, and Python required.

The predicted salary is between 80000 - 100000 £ per year.

Are you the right applicant for this opportunity? Find out by reading through the role overview below.

Opus is partnering with a new client to support a major data platform build, and we’re looking for a Senior Data Engineer to play a key role in the next phase of delivery. This is a hands-on contract position focused on building out a modern cloud-based data environment using Azure, Databricks, and Lakehouse architecture principles.

You’ll be working within a growing data function, helping to design and deliver scalable, production-grade data solutions that underpin reporting and analytics across the business. This role will suit someone who enjoys taking ownership, working closely with stakeholders, and translating business requirements into robust data engineering solutions.

What you'll be doing:

  • Design, build and optimise data pipelines using Azure Data Factory, Databricks, Python and SQL
  • Work within a Lakehouse / Medallion architecture framework
  • Develop and maintain data models and structures to support analytics and reporting
  • Work across Azure SQL / MS SQL environments
  • Improve and maintain CI/CD and deployment pipelines for data workflows
  • Support downstream analytics, including Power BI datasets
  • Contribute to data quality, governance and best practice standards

What we are looking for:

  • Strong hands-on experience with Databricks and Azure data platforms
  • Databricks certification (current/relevant)
  • Advanced SQL skills (MS SQL / Azure SQL)
  • Strong Python experience
  • Experience building scalable data platforms, ideally using Lakehouse architecture
  • Solid understanding of data modelling, data quality and governance
  • Experience working with Git and CI/CD pipelines

If this is a role that suits your skill set, you can travel to Cardiff on a hybrid basis of 2 days per week and available immediately then please apply for the job advert directly or reach out to me with your CV.

Senior Databricks Engineer employer: Opus Recruitment Solutions Ltd

At Opus, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration. As a Senior Databricks Engineer in Cardiff, you'll benefit from a hybrid working model, competitive rates, and the opportunity to contribute to cutting-edge data solutions while advancing your career in a supportive environment. Join us to be part of a growing team where your expertise will directly impact our data platform's success and your professional growth.

Opus Recruitment Solutions Ltd

Contact Details:

Opus Recruitment Solutions Ltd Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Senior Databricks Engineer

Tip Number 1

Network like a pro! Reach out to your connections in the data engineering field, especially those who work with Databricks or Azure. A friendly chat can lead to insider info about job openings that aren't even advertised yet.

Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure, Databricks, and Python. This gives potential employers a taste of what you can do and sets you apart from the crowd.

Tip Number 3

Prepare for interviews by brushing up on common data engineering questions and scenarios. Be ready to discuss your experience with CI/CD pipelines and data modelling, as these are hot topics for roles like the Senior Databricks Engineer.

Tip Number 4

Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who take the initiative to connect directly with us.

We think you need these skills to ace Senior Databricks Engineer

Databricks
Azure Data Factory
Python
SQL
Lakehouse Architecture
Data Modelling
Data Quality

Some tips for your application 🫡

Tailor Your CV:Make sure your CV highlights your experience with Databricks and Azure data platforms. We want to see how your skills align with the role, so don’t be shy about showcasing your hands-on experience!

Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re the perfect fit for this Senior Databricks Engineer role. Share specific examples of your past projects that relate to building scalable data solutions.

Show Off Your Technical Skills:Don’t forget to mention your advanced SQL and Python skills in your application. We’re looking for someone who can hit the ground running, so let us know how you’ve used these skills in previous roles.

Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you don’t miss out on any important updates regarding your application status!

How to prepare for a job interview at Opus Recruitment Solutions Ltd

Know Your Tech Inside Out

Make sure you brush up on your Databricks and Azure skills. Be ready to discuss specific projects where you've designed and built data pipelines, and don't shy away from diving into technical details. The more you can showcase your hands-on experience, the better!

Showcase Your Problem-Solving Skills

Prepare to talk about challenges you've faced in previous roles, especially around data quality and governance. Think of examples where you took ownership of a problem and how you translated business requirements into effective data solutions. This will demonstrate your ability to think critically and adapt.

Familiarise Yourself with Lakehouse Architecture

Since this role involves working within a Lakehouse framework, make sure you understand its principles and benefits. Be ready to discuss how you've implemented or optimised data models in similar architectures, as this will show you're aligned with their needs.

Engage with Stakeholders

Highlight your experience working closely with stakeholders. Prepare to discuss how you’ve collaborated with different teams to gather requirements and deliver solutions. This shows that you’re not just a techie but also someone who values communication and teamwork.