Data Engineer - Azure / DataBricks

Data Engineer - Azure / DataBricks

Temporary Home office (partial)
Shareforce

At a Glance

  • Tasks: Design and optimise data pipelines using Azure Databricks and collaborate with stakeholders.
  • Company: Join a leading team at the forefront of data analytics and AI.
  • Benefits: Competitive daily rate, hybrid work, and potential for contract extension.
  • Other info: Exciting opportunity with significant career growth in a dynamic environment.
  • Why this job: Make an impact in data engineering while mentoring junior engineers.
  • Qualifications: Experience with Azure Databricks, Python, SQL, and strong communication skills.

This is an exciting contract opportunity for an SC Cleared Azure Data Engineer with a strong focus on Databricks to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks solutions within the Azure ecosystem.
Responsibilities:

  • Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables.
  • Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions.
  • Drive best practices for data engineering.
  • Help clients realise the potential of data science, machine learning, and scaled data processing within Azure / Databricks ecosystem.
  • Mentor junior engineers and support their personal development.
  • Take ownership for the delivery of core solution components.
  • Support with planning, requirements refinements, and work estimation.

Skills & Experiences:
  • Proven experience designing and implementing data solutions in Azure using Databricks as a core platform.
  • Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows.
  • Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks.
  • Deep understanding of lakehouse architecture, with a solid grasp of data warehousing, data lakes, and real-time data processing.
  • Familiar with Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric.
  • Good experience with CI/CD practices and tools for data platforms using Azure DevOps.
  • Good knowledge on how to leverage AI to increase deployment productivity and quality.
  • Excellent communication skills.
  • Desirable: certification in Databricks Data Engineerand/or Azure Data Engineer are a plus.

Additional Information:
  • Rate offered: £500-550 per day
  • Location: Hybrid with travel to client site 1 day/ week in London
  • Start date: Mid/ end of July
  • Duration: 3 months initial sign up with significant opportunity for extension (current roadmap demonstrates 9 months scope of work)
  • Required: Active SC Clearance

Data Engineer - Azure / DataBricks employer: Shareforce

Join a forward-thinking team as a Data Engineer in London, where you'll be at the cutting edge of data analytics and AI. Our collaborative work culture fosters innovation and personal growth, offering mentorship opportunities and the chance to lead impactful projects within the Azure ecosystem. With a hybrid working model and competitive rates, we provide an environment that values your expertise while supporting your professional development.

Shareforce

Contact Details:

Shareforce Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Data Engineer - Azure / DataBricks

Tip Number 1

Network like a pro! Reach out to your connections in the data engineering field, especially those who work with Azure and Databricks. A friendly chat can lead to insider info about job openings that aren't even advertised yet.

Tip Number 2

Show off your skills! Create a portfolio showcasing your best projects using Azure Databricks. This could be anything from data pipelines to machine learning models. Having tangible examples of your work can really impress potential employers.

Tip Number 3

Prepare for interviews by brushing up on common data engineering questions, especially around Azure and Databricks. We recommend practicing coding challenges in Python and SQL to keep your skills sharp and ready for any technical tests.

Tip Number 4

Don’t forget to apply through our website! We’ve got loads of opportunities that might just be the perfect fit for you. Plus, it’s a great way to get noticed by our hiring team directly.

We think you need these skills to ace Data Engineer - Azure / DataBricks

Azure Databricks
Delta Lake
Delta Live Tables
Databricks Workflows
Python
SQL
Lakehouse Architecture

Some tips for your application 🫡

Tailor Your CV:Make sure your CV is tailored to the Data Engineer role. Highlight your experience with Azure and Databricks, and don’t forget to mention any relevant projects or achievements that showcase your skills in data engineering.

Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re the perfect fit for this role. Mention your hands-on expertise with Delta Live Tables and how you can help clients leverage data science and AI.

Showcase Your Technical Skills:Be specific about your technical skills in Python, SQL, and any CI/CD practices you've used. We want to see your coding prowess, so include examples of modular, reusable code you've developed in Databricks.

Apply Through Our Website:Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity. We can’t wait to see what you bring to the table!

How to prepare for a job interview at Shareforce

Know Your Tech Inside Out

Make sure you’re well-versed in Azure and Databricks, especially Delta Live Tables and Delta Lake. Brush up on your Python and SQL coding skills, as you might be asked to demonstrate your knowledge during the interview.

Showcase Your Problem-Solving Skills

Prepare to discuss specific examples where you've designed and implemented data solutions. Think about challenges you faced and how you overcame them, particularly in the context of data engineering and analytics.

Understand the Business Context

Familiarise yourself with the company’s goals and how they leverage data science and AI. Be ready to propose how your skills can help them achieve their objectives, especially in optimising data pipelines and driving best practices.

Be Ready to Collaborate

Since this role involves working with stakeholders, practice articulating your thoughts clearly. Highlight your experience mentoring junior engineers and how you’ve collaborated in past projects to deliver successful outcomes.