Principal Data Engineer (Databricks)
Principal Data Engineer (Databricks)

Principal Data Engineer (Databricks)

London Full-Time 56000 - 80000 £ / year (est.) No home office possible
Go Premium
D

At a Glance

  • Tasks: Lead complex data engineering projects and mentor junior engineers.
  • Company: DATAPAO is a fast-growing data consulting firm, recognised for innovation and excellence.
  • Benefits: Enjoy remote work, flexible PTO, educational perks, and top-notch equipment.
  • Why this job: Be the first UK hire and shape our regional growth while working with leading global companies.
  • Qualifications: 5+ years in Data Engineering, expertise in Databricks, SQL, and cloud platforms required.
  • Other info: Join a high-transparency culture focused on impact and continuous learning.

The predicted salary is between 56000 - 80000 £ per year.

Join DATAPAO, a leading Data Engineering and Data Science consulting company, recognised for our innovation and rapid growth. We are currently looking for a Senior Data Engineer to join us remotely in the UK.

You will work with our EMEA and US customers to help them solve their data engineering, ML, ML Ops, and cloud migration puzzles.

What will you do?

  • Deliver on some of our most complex projects - individually or by leading small delivery teams.
  • Manage customer relationships alone or in collaboration with a Project Manager.
  • Support our pre-sales process, mentor more junior engineers, and contribute to hiring best-in-class data talent.

What does it take to fit the bill?

Technical Expertise

  • 5+ years of experience in Data Engineering, with a focus on cloud platforms (AWS, Azure, GCP).
  • Proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog).
  • Extensive experience in ETL/ELT development and data pipeline orchestration.
  • Proficient in SQL and Python.
  • Experience integrating Databricks with BI tools (Power BI, Tableau, Looker).

Consulting & Client-Facing Skills

  • Proven history in consulting, from scoping to gathering requirements, designing solutions, and communicating effectively with stakeholders.
  • Successfully delivered projects like Data Lakehouse buildouts and cloud data migrations.
  • Excel in explaining technical concepts to non-technical audiences.

Operational Readiness & Soft Skills

  • Ready to contribute to live client projects.
  • Flexibility and problem-solving come naturally to you.
  • Strong communication skills.

What do we offer?

  • Fully remote setup for the time being.
  • World-class educational benefits, including access to Databricks' courses and certifications.
  • Flexible PTO days.
  • 4 weeks of paternity leave.
  • Employee Assistance Program (EAP).
  • Pension scheme enrollment and comprehensive private health insurance plan.
  • Top-notch working equipment.
  • Opportunity to make an impact in a high-transparency culture.

The gross salary for this position ranges from £70,000 to £100,000/year, depending on your assessed seniority level during the selection process.

We are committed to your privacy and to keeping your data safe with us. We do not share your data with any third parties and keep your application for two years unless you ask us otherwise.

Principal Data Engineer (Databricks) employer: DATAPAO

At DATAPAO, we pride ourselves on being an innovative leader in Data Engineering and Data Science consulting, offering a dynamic work culture that fosters collaboration and personal growth. As our first hire in the UK, you will have the unique opportunity to shape our regional expansion while enjoying flexible remote work, world-class educational benefits, and a supportive environment that values open feedback and employee well-being.
D

Contact Detail:

DATAPAO Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Principal Data Engineer (Databricks)

✨Tip Number 1

Familiarise yourself with Databricks and its ecosystem. Since this role heavily involves Databricks, having hands-on experience or even completing relevant online courses can set you apart. Consider showcasing any projects you've worked on that utilised Databricks.

✨Tip Number 2

Network with current employees or alumni from DATAPAO. Engaging with them on platforms like LinkedIn can provide you with insider knowledge about the company culture and expectations, which can be invaluable during interviews.

✨Tip Number 3

Prepare to discuss your consulting experience in detail. Since the role requires client-facing skills, be ready to share specific examples of how you've successfully managed client relationships and delivered complex projects in the past.

✨Tip Number 4

Demonstrate your problem-solving abilities. In a fast-paced consulting environment, being able to think on your feet is crucial. Prepare scenarios where you've had to adapt quickly to changes or challenges in a project.

We think you need these skills to ace Principal Data Engineer (Databricks)

5+ years of experience in Data Engineering
Proficiency in Databricks (PySpark, SQL, Delta Lake, Unity Catalog)
Extensive experience in ETL/ELT development and data pipeline orchestration
Familiarity with Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions
Strong SQL and Python skills for data transformation and optimisation
Knowledge of CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, Bicep)
Experience integrating Databricks with BI tools (Power BI, Tableau, Looker)
Proven history in consulting, including scoping, requirements gathering, and solution design
Ability to explain technical concepts to non-technical audiences
Flexibility and problem-solving skills in a fast-paced environment
Excellent communication skills, both written and verbal
Experience in delivering Data Lakehouse buildouts and cloud data migrations

Some tips for your application 🫡

Tailor Your CV: Make sure your CV highlights relevant experience in Data Engineering, particularly with Databricks and cloud platforms like AWS or Azure. Use specific examples of projects you've worked on that align with the job description.

Craft a Compelling Cover Letter: In your cover letter, express your passion for data engineering and how your skills can contribute to DATAPAO's growth. Mention your consulting experience and ability to communicate technical concepts to non-technical stakeholders.

Showcase Technical Skills: Clearly outline your technical expertise in SQL, Python, and ETL/ELT development. Provide examples of how you've used these skills in past roles, especially in fast-paced environments.

Highlight Soft Skills: Emphasise your problem-solving abilities, flexibility, and communication skills. Share instances where you've successfully navigated challenges in a consulting setting, as these traits are crucial for the role.

How to prepare for a job interview at DATAPAO

✨Showcase Your Technical Expertise

Make sure to highlight your experience with Databricks, Apache Spark, and cloud platforms like AWS or Azure. Be prepared to discuss specific projects where you've used these technologies, as this will demonstrate your hands-on skills and understanding of the tools they use.

✨Prepare for Client-Facing Scenarios

Since the role involves direct client interaction, practice explaining complex technical concepts in simple terms. Think of examples from your past experiences where you successfully communicated with non-technical stakeholders to drive decision-making.

✨Emphasise Your Problem-Solving Skills

In a fast-paced consulting environment, flexibility and resilience are key. Prepare to discuss challenges you've faced in previous roles and how you overcame them. This will show that you're ready to hit the ground running and can adapt to changing situations.

✨Demonstrate Your Mentorship Abilities

As a senior engineer, you'll be expected to mentor junior team members. Share any experiences you have in guiding others, whether through formal mentorship or simply helping colleagues with their projects. This will illustrate your leadership potential and commitment to team growth.

Principal Data Engineer (Databricks)
DATAPAO
Location: London
Go Premium

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

D
  • Principal Data Engineer (Databricks)

    London
    Full-Time
    56000 - 80000 £ / year (est.)
  • D

    DATAPAO

    50-100
Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>