Our key client is looking for an Azure Databricks Developer with SC and NPPv3 on a 6 months+ contract.
The Azure Databricks Developer is responsible for designing, developing, testing and supporting scalable data engineering solutions using Azure Databricks and the wider Azure data platform. The role focuses on building robust data ingestion, transformation and processing pipelines that enable advanced analytics, AI, machine learning and business intelligence solutions.
Working closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects, the Azure Databricks Developer helps deliver trusted, high-quality data products while ensuring adherence to security, governance and operational standards.
Requirement: NPPV3/SC clearance
Key Responsibilities
Data Engineering & Development
Design and develop data pipelines using Azure Databricks.
Build scalable ETL/ELT solutions using PySpark, Spark SQL and Delta Lake.
Develop ingestion frameworks for batch and streaming data.
Develop outbound pipelines that interface with APIs
Optimise large-scale data processing workloads for performance and cost efficiency.
Data Integration
Integrate data from:Azure SQL DatabaseAzure Data Lake Storage Gen2
Microsoft Fabric
APIs and third-party SaaS platforms
On-premise systems
Event streaming platforms
Implement automated data validation and reconciliation processes.
Data Modelling
Implement bronze, silver and gold data architectures.
Optimise storage structures using Delta Lake best practices.
Platform Engineering
Configure and maintain Databricks workspaces, clusters and compute resources.
Implement CI/CD pipelines for Databricks code deployments.Support environment promotion across development, test and production environments.Monitor and troubleshoot platform performance issues.Data Quality & Governance
Implement data quality controls.Support metadata management and lineage requirements.
Ensure compliance with security, privacy and governance standards.Contribute to data catalogue and documentation activities.Collaboration
Work with business stakeholders to understand data requirements.Support Data Architects in implementing target-state architectures.
Technical Skills
Essential
Azure Databricks
Apache S...
Azure Databricks Developer (SC / NPPv3) employer: Hays Specialist Recruitment Limited Careers
Hays Education is an exceptional employer, offering a supportive and collaborative work environment for SEN SLD/PMLD teachers in the Hounslow/Hillingdon area. With access to exclusive vacancies, ongoing professional development, and a dedicated consultant to guide your career, you will find ample opportunities for growth while making a meaningful impact on the lives of pupils with special educational needs. Join us to be part of a community that values inclusivity and fosters both personal and professional development.
Contact Details:
Hays Specialist Recruitment Limited Careers Recruitment Team
