At a Glance
- Tasks: Optimise and enhance an existing Databricks platform for performance and efficiency.
- Company: A growing business focused on innovative data solutions.
- Benefits: High-impact contract with competitive pay and flexible working options.
- Other info: Opportunity to lead strategic initiatives in a fast-paced, collaborative setting.
- Why this job: Make a visible difference in a dynamic environment while scaling a data platform.
- Qualifications: Proven Databricks expertise and strong data architecture knowledge required.
The predicted salary is between 60750 - 74250 £ per year.
Join Our Client as a Databricks SME – Strategic Technology Leadership Opportunity
A growing business is investing further in its data platform — but this one’s a little different.
Rather than building from scratch, they need a genuine Databricks SME to come in and optimise an existing platform: improving performance, cost efficiency, governance, and architecture as part of a wider greenfield initiative.
This is a high-impact contract for someone who knows Databricks inside out and wants to make an immediate, visible difference — not just maintain what’s already there.
You’ll work closely with stakeholders, reviewing the current setup, identifying where it’s falling short, and re-architecting where needed — all while the business scales.
- Proven experience as a Databricks SME, with hands‑on expertise in implementing and managing Databricks platforms.
- Strong understanding of data architecture, data pipelines, and AI/data foundations.
- Familiarity with Atlassian tools and their integration within complex data environments.
- Excellent communication skills, capable of guiding teams through technical discovery and strategic planning.
- Ability to work independently and collaboratively in a fast‑paced, innovative environment.
- Prior experience in the retail industry or similar sectors is advantageous.
Tech
- Databricks (Unity Catalog, cluster & job optimisation)
- Delta Lake / Lakehouse architecture
- Python / Py Spark
- SQL
- CI/CD, Terraform, orchestration tool if relevant
Bonus points for
cost governance frameworks, data quality/observability tooling, or experience taking a platform from “it works” to “it scales.”
If you’ve ever looked at a Databricks environment and thought “I know exactly how I’d fix this,” this is that project.
#J-18808-Ljbffr
Databricks SME employer: IO Associates
Join a leading engineering organisation that values innovation and excellence, offering a dynamic work culture where your contributions directly impact high-performance solutions in safety-critical environments. With a strong focus on employee growth, you will have the opportunity to mentor fellow engineers and shape technical direction while working in an Agile/SAFe environment. Located in the UK, this role provides a unique chance to be part of cutting-edge projects in defence, aerospace, and industrial technology, ensuring a rewarding and meaningful career path.
