Our client is seeking a Senior Platform Engineer to join its technology and data engineering team in a permanent hybrid role across Surrey and Greater London. This is a hands-on opportunity to help develop and optimise a Databricks data platform that supports analytics, machine learning and artificial intelligence across the business.
The experience expected from applicants, as well as additional skills and qualifications needed for this job are listed below.
Key Responsibilities:
- Design, build and enhance a secure, scalable and reliable Databricks platform
- Develop and maintain batch and real-time data pipelines using Databricks, Apache Spark and Delta Lake
- Contribute to platform architecture, engineering standards and best practices across the data estate
- Work with Product, Analytics and Data Science teams to deliver effective data platform solutions
- Support platform operations, monitoring, performance optimisation and reliability
- Apply Infrastructure as Code principles to support consistent and efficient platform management
- Share technical knowledge and contribute to continuous improvement across the engineering team
Job Requirements:
- Significant experience building and supporting scalable, production-grade data platforms
- Strong hands-on expertise with Databricks, Apache Spark, Delta Lake, Python and SQL
- Good understanding of cloud-based data engineering, ideally within Microsoft Azure environments
- Experience with Infrastructure as Code tools such as Terraform, Bicep or similar
- Understanding of data modelling, ETL and ELT processes, data quality, security and governance
- Ability to collaborate effectively with technical and non-technical stakeholders
- Experience with Unity Catalog, MLflow or Databricks Asset Bundles would be advantageous
- Knowledge of dbt, Kafka, xgikmsk Event Hubs or other data transformation and streaming technologies would be beneficial
Desirable Experience:
- Databricks certifications
- Experience working with retail or consumer packaged goods data, including point-of-sale, inventory or supply chain datasets
- Understanding of modern data platform architecture and cloud engineering practices
- A degree in Computer Science, Data Engineering or a related discipline, or equivalent practical experience
Benefits:
- H...
Platform Engineer in Westcott employer: Matchtech Careers
As a Business Reporting Analyst with our client, you will thrive in a dynamic work culture that values collaboration and innovation. The company offers excellent employee growth opportunities through continuous training and development, alongside competitive benefits that support work-life balance. Located in a vibrant area, this role not only allows you to make a meaningful impact on business decisions but also provides a supportive environment where your contributions are recognised and valued.
