Databricks Engineer - SC Cleared

This is an exciting contract opportunity for an SC Cleared Databricks Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks solutions within the AWS ecosystem.

Responsibilities

Design, build, and optimize end-to-end data pipelines using AWS and Databricks, including Delta Live Tables.

Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions.

Drive best practices for data engineering.

Help clients realize the potential of data science, machine learning, and scaled data processing within AWS / Databricks ecosystem.

Mentor junior engineers and support their personal development.

Take ownership for the delivery of core solution components.

Support with planning, requirements refinements, and work estimation.

Skills & Experiences

Proven experience designing and implementing data solutions in AWS using Databricks as a core platform.

Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows.

Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks.

Deep understanding of lakehouse architecture, with a solid grasp of data warehousing, data lakes, and real-time data processing.

Good experience with CI/CD practices and tools for data platforms.

Good knowledge on how to leverage AI to increase deployment productivity and quality.

Excellent communication skills.

Desirable: certification in Databricks Data Engineer and/or AWS Data Engineer are a plus.

Additional Information

Rate offered: £550-600 per day

IR35 Status: Outside

Location: Hybrid with 1 day per month travel to client site in the North East

Start date: January

Duration: 3 months initial sign up with significant opportunity for extension

Required: Active SC Clearance

#J-18808-Ljbffr