Senior Data Engineer - Databricks

Senior Data Engineer - Databricks

Full-Time 60750 - 74250 £ / year (est.) No working from home possible
I

At a Glance

  • Tasks: Lead the design and implementation of enterprise-scale data pipelines and lakehouse architectures.
  • Company: Join a forward-thinking company at the forefront of data engineering.
  • Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
  • Other info: Dynamic role with a focus on innovation and collaboration in a fast-paced environment.
  • Why this job: Shape the future of data platforms while mentoring the next generation of engineers.
  • Qualifications: 7+ years in data engineering with strong skills in Databricks and Spark.

The predicted salary is between 60750 - 74250 £ per year.

Job Role
We are seeking a Senior Databricks Data Engineer to lead delivery of data engineering workstreams within large-scale data platform and migration programmes.

This role combines hands-on technical expertise with consulting leadership, ensuring the successful design, delivery and operation of modern data platforms while working closely with client stakeholders.

You will play a key role in shaping architecture decisions, mentoring engineers and driving delivery across complex engagements.

Key Responsibilities

  • Lead design and implementation of enterprise-scale data pipelines and lakehouse architectures
  • Provide technical leadership across Databricks, Spark and cloud data platforms
  • Drive delivery of data engineering workstreams within Agile programmes
  • Engage with client stakeholders to translate business objectives into technical solutions
  • Mentor engineers and establish engineering best practices
  • Lead architecture and design discussions with architects and platform teams
  • Oversee performance optimisation and platform reliability
  • Support data migration strategy and execution
  • Ensure governance, security and compliance standards are met
  • Produce architecture documentation, design artefacts and delivery roadmaps
  • Key Requirements
  • 7+ years experience in data engineering or data platform development
  • Strong experience with Databricks, Spark and distributed data processing
  • Experience with Unity Catalog, Delta Lake and streaming architectures
  • Advanced Python and Microsoft SQL Server development
  • Proven experience leading engineering teams or workstreams
  • Strong stakeholder engagement and consulting skills
  • Working knowledge of Hadoop
  • Experience with test-driven development and CI/CD
  • REST APIs and Kafka experience
  • Nice to Have
  • Experience leading data platform migrations
  • Experience managing delivery in large transformation programmes
  • Experience delivering projects in regulated environments
  • #J-18808-Ljbffr

Senior Data Engineer - Databricks employer: ISx4 Group

ISx4 Group is an exceptional employer located in the vibrant city of Belfast, offering a dynamic work culture that fosters innovation and collaboration. As a Graduate AI Engineer, you will have access to extensive growth opportunities, working alongside experienced professionals while contributing to cutting-edge AI projects. The company prioritises employee development and provides a supportive environment where your contributions are valued, making it an ideal place for recent graduates looking to make a meaningful impact in the tech industry.

I

Contact Details:

ISx4 Group Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Senior Data Engineer - Databricks

Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like ISx4 Group!

Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Senior Data Engineer - Databricks at ISx4 Group.

Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like ISx4 Group.

Apply Directly through Our Website

When you find a suitable opening like Senior Data Engineer - Databricks at ISx4 Group, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Senior Data Engineer - Databricks

Databricks
Spark
Cloud Data Platforms
Data Pipeline Design
Lakehouse Architectures
Agile Methodologies
Stakeholder Engagement

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at ISx4 Group, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at ISx4 Group. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at ISx4 Group

Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at ISx4 Group!

Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.