Senior Databricks Data Engineer in London
Senior Databricks Data Engineer

Senior Databricks Data Engineer in London

London Full-Time 60000 - 80000 £ / year (est.) No home office possible
ISx4

At a Glance

  • Tasks: Lead the design and implementation of enterprise-scale data pipelines and lakehouse architectures.
  • Company: Join a dynamic team at the forefront of AI and cloud computing.
  • Benefits: Very competitive salary, hybrid work model, and opportunities for professional growth.
  • Other info: Be part of an ambitious hiring plan with excellent career advancement opportunities.
  • Why this job: Shape the future of data engineering while making a real-world impact.
  • Qualifications: 7+ years in data engineering with strong Databricks and Spark experience.

The predicted salary is between 60000 - 80000 £ per year.

Location: Northern Ireland (Hybrid)

Hours: Permanent Full-time

Salary: Very competitive

Hiring: ASAP

ISx4 is a dynamic and innovative team, harnessing the power of artificial intelligence and cloud computing to drive real-world impact. We work at the forefront of Analytics and AI technology, leveraging leading cloud platforms to build scalable, intelligent solutions. Our industry experience helps derive competitive advantage for our clients, taking them on the journey from Hindsight, through Insight to Foresight.

We create, deliver and manage Analytics and AI solutions across all sectors including finance, government, life sciences, private sector and sport. Our services are increasingly in demand as Analytics and AI services become a core competency in every area of the business. ISx4 are formal certified partners with SAS, Microsoft, AWS, GCP, IBM and Databricks and have customers & staff located globally. These strategic partnerships allow us to remain vendor-neutral and focused on our core competency area of analytics services delivery. ISx4 have an ambitious hiring plan for the next few years with new hires at all levels to support the strategic growth of the firm.

The Role

We are seeking a Senior Databricks Data Engineer to lead delivery of data engineering workstreams within large-scale data platform and migration programmes. This role combines hands-on technical expertise with consulting leadership, ensuring the successful design, delivery and operation of modern data platforms while working closely with client stakeholders. You will play a key role in shaping architecture decisions, mentoring engineers and driving delivery across complex engagements.

What You'll Do

  • Lead design and implementation of enterprise-scale data pipelines and lakehouse architectures
  • Provide technical leadership across Databricks, Spark and cloud data platforms
  • Drive delivery of data engineering workstreams within Agile programmes
  • Engage with client stakeholders to translate business objectives into technical solutions
  • Mentor engineers and establish engineering best practices
  • Lead architecture and design discussions with architects and platform teams
  • Oversee performance optimisation and platform reliability
  • Support data migration strategy and execution
  • Ensure governance, security and compliance standards are met
  • Produce architecture documentation, design artefacts and delivery roadmaps

Must-Have Requirements

  • 7+ years experience in data engineering or data platform development
  • Strong experience with Databricks, Spark and distributed data processing
  • Experience with Unity Catalog, Delta Lake and streaming architectures
  • Advanced Python and Microsoft SQL Server development
  • Experience designing enterprise data architectures
  • Proven experience leading engineering teams or workstreams
  • Strong stakeholder engagement and consulting skills
  • Working knowledge of Hadoop
  • Experience with test-driven development and CI/CD
  • REST APIs and Kafka experience

Nice to Have

  • Experience leading data platform migrations
  • Cloud architecture expertise (AWS preferred)
  • Experience managing delivery in large transformation programmes
  • Experience delivering projects in regulated environments

Senior Databricks Data Engineer in London employer: ISx4

ISx4 is an exceptional employer that fosters a dynamic and innovative work culture, where employees are empowered to harness the latest in AI and cloud computing technologies. Located in Northern Ireland, we offer a hybrid working model that promotes work-life balance, alongside competitive salaries and robust opportunities for professional growth through mentorship and leadership roles. Our commitment to employee development, coupled with our strategic partnerships with industry leaders, ensures that you will be at the forefront of analytics and AI solutions, making a meaningful impact across various sectors.
ISx4

Contact Detail:

ISx4 Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Senior Databricks Data Engineer in London

✨Tip Number 1

Network like a pro! Reach out to your connections in the industry, attend meetups, and engage with professionals on LinkedIn. We all know that sometimes it’s not just what you know, but who you know that can help you land that Senior Databricks Data Engineer role.

✨Tip Number 2

Prepare for those interviews by brushing up on your technical skills and understanding the latest trends in data engineering. We recommend practising common interview questions related to Databricks and Spark, so you can showcase your expertise confidently.

✨Tip Number 3

Don’t forget to tailor your approach! When you’re engaging with potential employers, highlight your experience with cloud platforms and data architectures. We want to see how your background aligns with their needs, so make it clear how you can drive delivery and mentor teams.

✨Tip Number 4

Finally, apply through our website! It’s the best way to ensure your application gets noticed. We’re always on the lookout for talented individuals like you to join our dynamic team and help us shape the future of analytics and AI.

We think you need these skills to ace Senior Databricks Data Engineer in London

Databricks
Spark
Cloud Data Platforms
Data Engineering
Enterprise Data Architectures
Python
Microsoft SQL Server
Unity Catalog
Delta Lake
Streaming Architectures
Stakeholder Engagement
Consulting Skills
Hadoop
Test-Driven Development
CI/CD

Some tips for your application 🫡

Tailor Your CV: Make sure your CV is tailored to the Senior Databricks Data Engineer role. Highlight your experience with Databricks, Spark, and any relevant cloud platforms. We want to see how your skills align with our needs!

Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about data engineering and how you can contribute to our innovative team. Let us know what excites you about working with AI and cloud computing.

Showcase Your Projects: If you've worked on any impressive data projects, make sure to mention them! We love seeing real-world examples of your work, especially those that demonstrate your leadership and technical skills in data engineering.

Apply Through Our Website: Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to see what you bring to the table!

How to prepare for a job interview at ISx4

✨Know Your Tech Inside Out

Make sure you brush up on your Databricks, Spark, and cloud data platforms knowledge. Be ready to discuss your hands-on experience with these technologies, as well as any specific projects you've worked on that showcase your skills in building data pipelines and lakehouse architectures.

✨Showcase Your Leadership Skills

Since this role involves mentoring engineers and leading workstreams, be prepared to share examples of how you've successfully led teams in the past. Highlight your experience in driving delivery within Agile programmes and how you've engaged with stakeholders to translate business objectives into technical solutions.

✨Prepare for Architecture Discussions

Expect to dive deep into architecture and design discussions during the interview. Familiarise yourself with best practices in enterprise data architecture and be ready to discuss how you've shaped architecture decisions in previous roles, especially in relation to performance optimisation and platform reliability.

✨Understand the Business Context

It's crucial to connect your technical expertise with the business impact. Research ISx4's industry experience and think about how your skills can help derive competitive advantages for their clients. Be ready to discuss how you can support their journey from Hindsight to Foresight using your data engineering skills.

Senior Databricks Data Engineer in London
ISx4
Location: London

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>