At a Glance
- Tasks: Build and optimise data pipelines using Databricks and lead technical projects.
- Company: Fast-growing Data & AI Consultancy with a focus on innovation.
- Benefits: Competitive daily rate, fully remote work, and flexible contract terms.
- Other info: Opportunity for career growth and mentorship in a collaborative environment.
- Why this job: Join a dynamic team and shape the future of data engineering.
- Qualifications: Strong experience in Databricks, PySpark, and data architecture.
The predicted salary is between 63000 - 77000 £ per year.
£550-£700 per day | Outside IR35 | Fully Remote UK | ASAP
Primus Connect is working with a fast-growing Data & AI Consultancy that is scaling its Databricks engineering capability across multiple client projects. We’re looking for experienced Databricks Data Engineers at both Senior and Principal level to join the team on an initial contract engagement.
These roles range from hands‑on senior engineering through to principal‑level technical leadership and architecture.
What you’ll be working on:
- Building production‑grade data pipelines using Databricks, PySpark and Spark SQL
- Designing Delta Lake and Medallion Architecture solutions
- Developing scalable ingestion and transformation pipelines
- Implementing Unity Catalog for governance, lineage and access control
- Building CI/CD and Infrastructure‑as‑Code using Terraform / Databricks Asset Bundles
- Spark performance optimisation and cost optimisation
- Establishing data engineering standards and best practices
- Supporting and mentoring other engineers
- Working closely with technical and business stakeholders
At Principal level, you’ll also take ownership of platform architecture, set technical direction and act as a technical authority across Databricks engineering workstreams.
What we’re looking for:
- You’ll need strong commercial experience across:
- Databricks
- PySpark
- Spark SQL
- Medallion Architecture
- Unity Catalog
- Python
- Terraform / Infrastructure-as-Code
- CI/CD
- Experience with Databricks Asset Bundles, Delta Sharing, Lakehouse Federation, Structured Streaming, Kafka or MLflow would also be beneficial.
- For Principal-level opportunities, we’re particularly interested in people who have previously operated as a Principal Data Engineer, Lead Data Engineer or Databricks Architect and can demonstrate ownership of large-scale Databricks platforms.
Principal Data Engineer: Up to £700 per day
Location: Fully Remote - UK
Start: ASAP
If you’re an experienced Databricks Data Engineer looking for your next contract, apply with your latest CV.
Senior / Principal Data Engineers employer: Primus Connect
Join a dynamic and innovative company that prioritises collaboration and employee growth, making it an excellent employer for a Data Engineering Manager. With a strong focus on mentorship, you will have the opportunity to lead a growing team while working in a vibrant office environment in central London/Guildford, complete with a free onsite restaurant and gym. This role not only allows you to shape impactful data platforms but also fosters a culture of rapid delivery and teamwork, ensuring your contributions are valued and recognised.
