The opportunity
We are recruiting a Cloud Data Platform Engineer to take ownership of the technology environment supporting our data engineering, analytics and machine learning teams.
Your focus will be on making the platform dependable, secure and efficient. You will combine hands-on engineering with operational ownership, helping technical teams deliver their work without unnecessary infrastructure or access barriers.
Working alongside engineering and analytics colleagues, you will develop the platform’s capabilities, strengthen its controls and improve the way it is deployed, monitored and maintained.
What you will be responsible for Platform engineering and automation
Manage Databricks environments and the compute resources used for data processing, SQL analysis and modelling.
Develop repeatable infrastructure deployments using Terraform and version-controlled configuration.
Establish automated release processes, ensuring platform changes are tested, reviewed and deployed consistently.
Maintain reusable configurations and engineering standards that simplify the setup of new workloads.
Support workflow scheduling and integrations with the wider data ecosystem.
Security and data governance
Administer Unity Catalog and maintain appropriate permissions across data assets and environments.
Configure identities, service accounts, authentication integrations and secrets management.
Work with relevant colleagues to implement network controls, encryption and secure access.
Maintain the controls and records needed to support auditing, data traceability and compliance requirements.
Performance and operational management
Investigate and improve the performance of Spark workloads, Delta tables and SQL compute.
Review resource consumption and identify ways to reduce unnecessary platform and cloud expenditure.
Set up monitoring and alerting to identify failures, performance issues and capacity constraints.
Resolve platform incidents, document their causes and introduce improvements that prevent recurrence.
Maintain operational documentation and review changes for quality and reliability.
Supporting ...
Databricks Platform Engineer employer: FLTalent Careers
Join our dynamic consultancy firm in the vibrant city of Brighton, where we empower businesses through innovative technology and exceptional service. As a Graduate Developer, you'll benefit from a structured training programme, exposure to diverse projects, and a supportive culture that values personal growth and collaboration. With a competitive salary and a focus on employee development, this is an excellent opportunity to kickstart your career in a meaningful and rewarding environment.