At a Glance
- Tasks: Design and maintain cloud-based data infrastructure using Azure and Databricks.
- Company: Join a leading financial services client focused on innovation.
- Benefits: Hybrid work model, competitive salary, and opportunities for professional growth.
- Why this job: Be part of a forward-thinking team driving data technology advancements.
- Qualifications: 5+ years experience with Azure services and strong skills in Databricks.
- Other info: Collaborative environment with a focus on knowledge sharing and career development.
The predicted salary is between 48000 - 72000 Β£ per year.
McCabe & Barton are partnering with a leading financial services client to recruit an experienced Data Platform Engineer. This is an excellent opportunity to join a forward-thinking team driving innovation with modern cloud-based data technologies.
Role Overview
As a Data Platform Engineer, you will design, build, and maintain scalable cloud-based data infrastructure using Azure and Databricks. You'll play a key role in ensuring that data pipelines, architecture, and analytics environments are reliable, performant, and secure.
Key Responsibilities
- Platform Development & Maintenance
- Design and implement data pipelines using Azure Data Factory, Databricks, and related Azure services.
- Build ETL/ELT processes to transform raw data into structured, analytics-ready formats.
- Optimise pipeline performance and ensure high availability of data services.
- Infrastructure & Architecture
- Architect and deploy scalable data lake solutions using Azure Data Lake Storage.
- Implement governance and security measures across the platform.
- Leverage Terraform or similar IaC tools for controlled and reproducible deployments.
- Databricks Development
- Develop and optimise data jobs using PySpark or Scala within Databricks.
- Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions.
- Manage cluster configurations and CI/CD pipelines for Databricks deployments.
- Monitoring & Operations
- Implement monitoring solutions using Azure Monitor, Log Analytics, and Databricks tools.
- Optimise performance, ensure SLAs are met, and establish disaster recovery and backup strategies.
- Collaboration & Documentation
- Partner with data scientists, analysts, and business stakeholders to deliver effective solutions.
- Document technical designs, data flows, and operational procedures for knowledge sharing.
Essential Skills & Experience
- 5+ years of experience with Azure services (Azure Data Factory, ADLS, Azure SQL Database, Synapse Analytics).
- Strong hands-on expertise in Databricks, Delta Lake, and cluster management.
- Proficiency in SQL and Python for pipeline development.
- Familiarity with Git/GitHub and CI/CD practices.
- Understanding of data modelling, data governance, and security principles.
Desirable Skills
- Experience with Terraform or other Infrastructure-as-Code tools.
- Familiarity with Azure DevOps or similar CI/CD platforms.
- Experience with data quality frameworks and testing.
- Azure Data Engineer or Databricks certifications.
Please apply with an updated CV if you align to the key skills required!
Data Platform Engineer in London employer: Mccabe & Barton
Contact Detail:
Mccabe & Barton Recruiting Team
StudySmarter Expert Advice π€«
We think this is how you could land Data Platform Engineer in London
β¨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
β¨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure and Databricks. This gives potential employers a taste of what you can do and sets you apart from the crowd.
β¨Tip Number 3
Prepare for interviews by brushing up on common technical questions related to data pipelines and cloud infrastructure. Practise explaining your thought process clearly, as communication is key in tech roles.
β¨Tip Number 4
Donβt forget to apply through our website! Itβs the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Data Platform Engineer in London
Some tips for your application π«‘
Tailor Your CV: Make sure your CV is tailored to the Data Platform Engineer role. Highlight your experience with Azure services, Databricks, and any relevant projects you've worked on. We want to see how your skills align with what we're looking for!
Showcase Your Projects: Include specific examples of projects where you've designed or maintained data pipelines or cloud infrastructure. This gives us a clear picture of your hands-on experience and problem-solving abilities in real-world scenarios.
Keep It Clear and Concise: When writing your application, be clear and concise. Use bullet points for easy reading and make sure to highlight your key achievements. We appreciate straightforward communication that gets to the point!
Apply Through Our Website: Don't forget to apply through our website! Itβs the best way for us to receive your application and ensures youβre considered for the role. Plus, it shows you're keen on joining our team at StudySmarter!
How to prepare for a job interview at Mccabe & Barton
β¨Know Your Tech Stack
Make sure youβre well-versed in Azure services, Databricks, and the tools mentioned in the job description. Brush up on your knowledge of Azure Data Factory, Delta Lake, and ETL processes. Being able to discuss these technologies confidently will show that you're ready to hit the ground running.
β¨Showcase Your Problem-Solving Skills
Prepare to discuss specific challenges you've faced in previous roles and how you overcame them. Think about times when you optimised data pipelines or implemented governance measures. This will demonstrate your hands-on experience and ability to tackle real-world problems.
β¨Understand the Medallion Architecture
Since the role involves implementing the medallion architecture, make sure you can explain it clearly. Be ready to discuss how you would structure data across bronze, silver, and gold layers, and why this approach is beneficial for data reliability and performance.
β¨Ask Insightful Questions
Prepare a few thoughtful questions about the teamβs current projects or the companyβs data strategy. This shows your genuine interest in the role and helps you gauge if the company culture aligns with your values. Plus, it gives you a chance to engage with your interviewers on a deeper level.