Databricks Platform Engineer in London

Databricks Platform Engineer in London

London Full-Time 60000 - 80000 € / year (est.) Home office (partial)
H

At a Glance

  • Tasks: Design and implement scalable Databricks platforms on AWS/Azure, ensuring robust data governance.
  • Company: Join a leading tech consultancy with a focus on innovative data solutions.
  • Benefits: Competitive salary, flexible hybrid work, and opportunities for professional growth.
  • Other info: Dynamic team environment with opportunities for travel and client engagement.
  • Why this job: Make an impact by building cutting-edge data platforms that drive client success.
  • Qualifications: 3+ years in data platform engineering; strong Databricks and cloud experience required.

The predicted salary is between 60000 - 80000 € per year.

Location: Hybrid / Monument St, London EC3R 8AJ, UK

Job type: Permanent / Full-time

Sector and subsector: IT | Data Engineer

Salary: Competitive salary

Platform Architecture & Engineering responsibilities

  • Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements.
  • Architect end-to-end data platforms including ingestion, storage (Delta Lake), processing, and consumption layers.
  • Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles (DAB's)).
  • Establish secure, compliant environments including networking (VNet/VPC, Private Link), identity (IAM/Entra ID), data governance (Unity Catalog), and access controls.
  • Define environment strategies (dev/test/prod), CI/CD pipelines, and release processes for Databricks deployments.
  • Implement monitoring, logging, cost optimisation, and performance tuning across the platform.
  • Design and implement data pipelines using Delta Live Tables, Auto Loader, and Databricks Workflows for both batch and streaming workloads.

Client Delivery & Enablement responsibilities

  • Work directly with clients to translate business and technical requirements into scalable platform designs.
  • Lead technical workshops, architecture sessions, and whiteboarding engagements with client stakeholders.
  • Support rapid prototyping and proof-of-concept builds within Databricks to demonstrate platform capabilities and accelerate client adoption.
  • Provide best practice guidance on Lakehouse architecture, data modelling, workload optimisation, and cost management.
  • Produce high-quality technical documentation including architecture diagrams, architecture decision records (ADRs), runbooks, and deployment guides.
  • Enable client teams through structured knowledge transfer, training, and platform handover.
  • Collaborate with data engineers, data scientists, and product teams to ensure successful delivery outcomes.

Governance & Security

  • Implement Unity Catalog for centralised data governance, including access control (RBAC/ABAC), data lineage, audit logging, and compliance enforcement.
  • Apply security best practices across platform design: network isolation, secret management, encryption at rest and in transit, and identity federation.
  • Ensure platform designs meet client regulatory and compliance requirements (e.g. GDPR, ISO 27001, sector-specific standards).

What success looks like in the role

  • Delivery of robust, secure, and scalable Databricks platforms that meet client performance and cost expectations.
  • Clear, well-architected solutions that balance flexibility, governance, and operational efficiency.
  • Strong client relationships built on trust, technical credibility, and effective communication.
  • Accelerated client adoption of the Lakehouse platform through well-designed enablement and documentation.
  • Reduced deployment time through reusable infrastructure patterns and automation.
  • Proactive identification of risks, trade-offs, and optimisation opportunities across platform design and delivery.
  • Contribution to the organisation’s growing body of reusable platform accelerators, reference architectures, and internal knowledge.

Competencies and Behaviours

  • 3+ years experience in data platform engineering, cloud engineering, or similar roles.
  • Strong hands-on experience with Databricks, including Apache Spark, Delta Lake, Workflows.
  • Proven experience designing and deploying data platforms on AWS and/or Azure (e.g. ADLS, S3, VNet/VPC, IAM).
  • Experience with infrastructure-as-code tools (e.g. Terraform preferred) and CI/CD pipelines (e.g. Azure DevOps, GitHub Actions).
  • Solid understanding of data architecture concepts including Lakehouse medallion architecture and dimensional modelling.
  • Familiarity with security and governance frameworks (e.g. RBAC, ABAC, data masking, audit, compliance standards).
  • Excellent communication skills with the ability to explain complex technical concepts to non-technical stakeholders.
  • Comfortable working in a client-facing consultancy environment with multiple concurrent engagements.
  • Proactive, self-driven, and able to take ownership of end-to-end platform delivery.
  • Willingness to travel within the UK as required.
  • Right to work in the UK.

Databricks Platform Engineer in London employer: Hollybank Trustees Ltd

As a Databricks Platform Engineer at our London office, you will thrive in a dynamic hybrid work environment that fosters innovation and collaboration. We offer competitive salaries, comprehensive benefits, and ample opportunities for professional growth, ensuring you can develop your skills while working on cutting-edge data solutions. Our inclusive culture encourages knowledge sharing and client engagement, making it an ideal place for those seeking meaningful and rewarding employment.

H

Contact Detail:

Hollybank Trustees Ltd Recruiting Team

StudySmarter Expert Advice🤫

We think this is how you could land Databricks Platform Engineer in London

Tip Number 1

Network, network, network! Get out there and connect with people in the industry. Attend meetups, webinars, or even just grab a coffee with someone who works in data engineering. You never know who might have a lead on your dream job!

Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those involving Databricks and cloud platforms. This will give potential employers a taste of what you can do and set you apart from the crowd.

Tip Number 3

Prepare for interviews by brushing up on your technical knowledge and soft skills. Practice explaining complex concepts in simple terms, as you'll need to communicate effectively with both technical and non-technical stakeholders.

Tip Number 4

Don't forget to apply through our website! We love seeing candidates who are genuinely interested in joining our team. Plus, it gives you a chance to showcase your enthusiasm for the role right from the start.

We think you need these skills to ace Databricks Platform Engineer in London

Databricks
Apache Spark
Delta Lake
Workflows
AWS
Azure
Infrastructure-as-Code (Terraform)

Some tips for your application 🫡

Tailor Your CV:Make sure your CV is tailored to the Databricks Platform Engineer role. Highlight your experience with Databricks, AWS/Azure, and any relevant projects that showcase your skills in data platform engineering.

Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about this role and how your background aligns with our needs. Don’t forget to mention specific projects or experiences that relate to the job description.

Showcase Your Technical Skills:In your application, be sure to highlight your hands-on experience with tools like Terraform, CI/CD pipelines, and data architecture concepts. We want to see how you can bring your technical expertise to our team!

Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team!

How to prepare for a job interview at Hollybank Trustees Ltd

Know Your Databricks Inside Out

Make sure you brush up on your Databricks knowledge, especially around Delta Lake and Apache Spark. Be ready to discuss how you've designed and implemented data platforms in the past, as well as any challenges you've faced and how you overcame them.

Showcase Your Cloud Skills

Since this role involves working with AWS and Azure, be prepared to talk about your experience with these platforms. Highlight any projects where you've built cloud infrastructure using infrastructure-as-code tools like Terraform, and explain how you ensured security and compliance.

Communicate Clearly and Confidently

You'll need to explain complex technical concepts to non-technical stakeholders, so practice articulating your thoughts clearly. Use examples from your past experiences to demonstrate your ability to communicate effectively and build strong client relationships.

Prepare for Technical Scenarios

Expect to engage in technical workshops or whiteboarding sessions during the interview. Prepare by thinking through potential scenarios related to platform architecture and data governance, and be ready to showcase your problem-solving skills in real-time.