Location: Remote with occasional site visits in either London or Birmingham Build, maintain and optimise Databricks data pipelines using PySpark, SQL and Delta Lake to transform raw data into curated, business-ready datasets. Manage production deployments through Azure DevOps (ADO), including code reviews, testing, release management and work tracking. Monitor and troubleshoot data pipelines, resolving issues and optimising performance, reliability and cost. Implement data quality checks and governance controls using Unity Catalog to ensure data integrity, security and compliance. Collaborate with business stakeholders and the Platform team to translate requirements into technical solutions, maintaining clear documentation and support runbooks. Proven commercial experience as a Databricks Engineer, Data Engineer or Data Platform Engineer, with hands-on experience supporting production environments. Strong technical expertise in Databricks, PySpark, SQL and Delta Lake, including data transformation and pipeline optimisation. Experience with Azure DevOps (ADO), including CI/CD pipelines, code reviews, automated testing and production releases. Knowledge of Unity Catalog, data governance, data quality validation and production monitoring. Strong problem-solving and communication skills, with the ability to work collaboratively with business and technical teams Interviews: October 2026 Start Date: November 2026 #J-18808-Ljbffr
Databricks Engineer employer: X4 Technology
Join a leading global energy trading business that values its employees and fosters a dynamic work culture. With a hybrid working model in London, you will enjoy a competitive salary, substantial bonuses, and opportunities for professional growth while working closely with traders and senior stakeholders on high-value transactions. This role offers the chance to make a meaningful impact in a fast-paced environment, ensuring your contributions are recognised and rewarded.
