Daily Rate: Up to £400 Per Day OUTSIDE IR35
Duration: 3 Months
About the role:
We are looking for an experienced Databricks Engineer to build data pipelines and AI solutions for a major UK client. You will transform data from multiple sources into trusted datasets for reporting and AI applications.
What you will do:
- Build Databricks pipelines using the Medallion Architecture (Bronze, Silver and Gold layers).
- Configure Unity Catalog to manage permissions, data access and lineage.
- Develop AI solutions
- Deploy across Dev, Test and Production using Asset Bundles and CI/CD.
- Optimise pipeline performance and manage cluster costs.
- Implement data quality checks to identify issues early.
- Work with architects and business stakeholders to deliver technical solutions.
What you will bring:
- Databricks experience, including PySpark, Spark SQL, Delta Lake, Delta Live Tables and Workflows.
- Hands-on Unity Catalog configuration, including schemas, groups and permissions.
- Delivered at least one Databricks AI solution.
- Strong Python and SQL skills.
- Azure Data Factory and Azure Data Lake Storage (ADLS) experience.
- Experience with Asset Bundles or Terraform and CI/CD deployments.
- Strong communication skills across technical and business teams.
Databricks Engineer employer: Lumora Solutions
As an Artificial Intelligence Consultant at our company, you will be part of a dynamic and innovative team dedicated to pushing the boundaries of AI technology. We offer a hybrid work environment that promotes flexibility and work-life balance, alongside competitive salaries and opportunities for professional growth in a rapidly evolving field. Join us to collaborate with top-tier clients on impactful projects while utilising cutting-edge technologies in a supportive and forward-thinking culture.
