Databricks Engineer

Databricks Engineer

Glasgow Full-Time No home office possible
C

GET THE FUTURE YOU WANT!

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

YOUR ROLE

We are currently migrating our data pipelines from AWS to Databricks, and are seeking

a Senior Databricks Engineer to lead and contribute to this transformation. This is a

hands-on engineering role focused on designing, building, and optimizing scalable data

solutions using the Databricks platform.

YOUR PROFILE

  • Lead the migration of existing AWS-based data pipelines to Databricks.
  • Design and implement scalable data engineering solutions using Apache Spark on Databricks.
  • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines.
  • Optimize performance and cost-efficiency of Databricks workloads.
  • Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools.
  • Ensure data quality and reliability through robust unit testing and validation frameworks.
  • Implement best practices for data governance, security, and access control within Databricks.
  • Provide technical mentorship and guidance to junior engineers
  • Lead the migration of existing AWS-based data pipelines to Databricks.
  • Design and implement scalable data engineering solutions using Apache Spark on
  • Databricks.
  • • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines.
  • Optimize performance and cost-efficiency of Databricks workloads.
  • Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools.
  • Ensure data quality and reliability through robust unit testing and validation frameworks.
  • Implement best practices for data governance, security, and access control within Databricks.
  • Provide technical mentorship and guidance to junior engineers

ABOUT CAPGEMINI

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 350,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.

Get the future you want | www.capgemini.com

C

Contact Detail:

Capgemini Recruiting Team

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

C
Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>