Azure Databricks Data Engineer | Outside IR35 | £450 - £500 | Hybrid | Nottingham We're looking for an experienced Data Engineer with strong Azure Databricks expertise to support the design, development, and optimisation of modern data platforms. You'll be responsible for building scalable data pipelines, managing large datasets, and delivering high-quality data solutions within an Azure environment. Key Skills & Experience Required Strong hands-on experience with Python, PySpark, and SQL/Spark SQL for building production-grade ETL/ELT pipelines Solid knowledge of Apache Spark, including DataFrames, joins, aggregations, partitioning, caching, and performance optimisation Experience working within Azure Databricks, including clusters, job clusters, notebooks, repositories, jobs, and Databricks Runtime Proven experience implementing Lakehouse architectures, including Bronze, Silver, and Gold data layers on Azure Data Lake Storage Gen2 Familiarity with modern data ingestion approaches, including Auto Loader, batch processing, incremental loads, and Change Data Capture (CDC) Experience orchestrating workflows using Lakeflow Jobs and Lakeflow Pipelines Working knowledge of Unity Catalog, including schemas, tables, access controls, and data governance best practices Experience with Git-based version control and CI/CD processes, ideally using Azure DevOpsDesirable Skills Experience with Kafka and real-time or streaming data solutions Exposure to Debezium and CDC frameworks Knowledge of Kimball dimensional modelling and enterprise data warehouse design principles If this Data Engineer role sounds like a good fit, you can work 3 days per week on site in Nottingham and you’d like to know more, please apply with your most up‑to‑date CV and I’ll be in touch. Azure Databricks Data Engineer | Outside IR35 | £450 - £500 | Hybrid | Nottingham
Azure Databricks Data Engineer in Nottingham employer: Opus Recruitment Solutions
Join a forward-thinking company that values innovation and collaboration, offering a dynamic work culture where your contributions as a ServiceNow Mapping Product Lead will directly impact large-scale digital transformation initiatives. With a focus on employee growth, we provide ample opportunities for professional development and the chance to work alongside industry leaders in a hybrid environment that promotes work-life balance. Our commitment to excellence and support for your career aspirations make us an exceptional employer in the tech landscape.
Contact Details:
Opus Recruitment Solutions Recruitment Team
