Azure Databricks Data Engineer | Outside IR35 | £450 - £500 | Hybrid | Nottingham We're looking for an experienced Data Engineer with strong Azure Databricks expertise to support the design, development, and optimisation of modern data platforms. You'll be responsible for building scalable data pipelines, managing large datasets, and delivering high-quality data solutions within an Azure environment. Key Skills Experience Required Strong hands-on experience with Python, PySpark , and SQL/Spark SQL for building production-grade ETL/ELT pipelines Solid knowledge of Apache Spark , including DataFrames, joins, aggregations, partitioning, caching, and performance optimisation Experience working within Azure Databricks , including clusters, job clusters, notebooks, repositories, jobs, and Databricks Runtime Proven experience implementing Lakehouse architectures , including Bronze, Silver, and Gold data layers on Azure Data Lake Storage Gen2 Familiarity with modern data ingestion approaches, including Auto Loader , batch processing, incremental loads, and Change Data Capture (CDC) Experience orchestrating workflows using Lakeflow Jobs and Lakeflow Pipelines Working knowledge of
Azure Databricks Data Engineer in Nottingham employer: Opus Recruitment Solutions Ltd Careers
As a leading player in the public sector, we pride ourselves on fostering a collaborative and innovative work culture that empowers our employees to excel. With a strong focus on professional development, we offer numerous growth opportunities and support for continuous learning, ensuring that our team members are equipped to tackle complex challenges in data and analytics. Working remotely with flexible arrangements, you will be part of a dynamic environment that values your expertise and contributions, making it an excellent place for meaningful and rewarding employment.
Contact Details:
Opus Recruitment Solutions Ltd Careers Recruitment Team
