At a Glance
- Tasks: Design and maintain cloud-based data infrastructure using Azure and Databricks.
- Company: Join a leading financial services client driving innovation in data technology.
- Benefits: Hybrid work model, competitive pay, and opportunities for professional growth.
- Other info: Collaborative environment with a focus on innovation and career development.
- Why this job: Be part of a forward-thinking team and make an impact with modern data solutions.
- Qualifications: 5+ years experience with Azure, Databricks, SQL, and Python.
The predicted salary is between 60000 - 80000 € per year.
Hybrid (3 days in the office, 2 days WFH) London McCabe & Barton are partnering with a leading financial services client to recruit an experienced Interim Data Platform Engineer for a 6 month contract opportunity for an Investment House. This is an excellent opportunity to join a forward-thinking team driving innovation with modern cloud-based data technologies.
Role Overview
As a Data Platform Engineer, you will design, build, and maintain scalable cloud-based data infrastructure using Azure and Databricks. You’ll play a key role in ensuring that data pipelines, architecture, and analytics environments are reliable, performant, and secure.
Key Responsibilities
- Platform Development & Maintenance
- Design and implement data pipelines using Azure Data Factory, Databricks, and related Azure services.
- Build ETL/ELT processes to transform raw data into structured, analytics-ready formats.
- Optimise pipeline performance and ensure high availability of data services.
- Infrastructure & Architecture
- Architect and deploy scalable data lake solutions using Azure Data Lake Storage.
- Implement governance and security measures across the platform.
- Leverage Terraform or similar IaC tools for controlled and reproducible deployments.
- Databricks Development
- Develop and optimise data jobs using PySpark or Scala within Databricks.
- Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions.
- Manage cluster configurations and CI/CD pipelines for Databricks deployments.
- Monitoring & Operations
- Implement monitoring solutions using Azure Monitor, Log Analytics, and Databricks tools.
- Optimise performance, ensure SLAs are met, and establish disaster recovery and backup strategies.
- Collaboration & Documentation
- Partner with data scientists, analysts, and business stakeholders to deliver effective solutions.
- Document technical designs, data flows, and operational procedures for knowledge sharing.
Essential Skills & Experience
- 5+ years of experience with Azure services (Azure Data Factory, ADLS, Azure SQL Database, Synapse Analytics).
- Strong hands-on expertise in Databricks, Delta Lake, and cluster management.
- Proficiency in SQL and Python for pipeline development.
- Familiarity with Git/GitHub and CI/CD practices.
- Understanding of data modelling, data governance, and security principles.
Desirable Skills
- Experience with Terraform or other Infrastructure-as-Code tools.
- Familiarity with Azure DevOps or similar CI/CD platforms.
- Experience with data quality frameworks and testing.
- Azure Data Engineer or Databricks certifications.
Please apply with an updated CV if you align to the key skills required!
Data Platform Engineer in London employer: McCabe & Barton
At McCabe & Barton, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration. Our hybrid working model allows for flexibility, with three days in the office and two days working from home, ensuring a healthy work-life balance. We are committed to employee growth, providing opportunities for professional development and exposure to cutting-edge cloud technologies in the heart of London’s financial services sector.
StudySmarter Expert Advice🤫
We think this is how you could land Data Platform Engineer in London
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, attend meetups, and engage with professionals on LinkedIn. We all know that sometimes it’s not just what you know, but who you know that can help you land that Data Platform Engineer role.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure, Databricks, and data pipelines. We want to see your hands-on experience, so make sure to highlight any relevant work that demonstrates your expertise.
✨Tip Number 3
Prepare for interviews by brushing up on common technical questions related to data engineering. We recommend practising coding challenges and discussing your past projects. This will help you articulate your experience and problem-solving skills effectively.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we’re always looking for talented individuals like you to join our forward-thinking team. So, get your CV ready and hit that apply button!
We think you need these skills to ace Data Platform Engineer in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with Azure services and Databricks. We want to see how your skills align with the role, so don’t be shy about showcasing relevant projects or achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about data engineering and how you can contribute to our innovative team. Keep it concise but impactful!
Showcase Your Technical Skills:When detailing your experience, focus on your hands-on expertise with tools like Azure Data Factory and PySpark. We love seeing specific examples of how you've optimised data pipelines or implemented governance measures.
Apply Through Our Website:We encourage you to apply directly through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any updates!
How to prepare for a job interview at McCabe & Barton
✨Know Your Tech Stack
Make sure you’re well-versed in Azure services, Databricks, and the tools mentioned in the job description. Brush up on your knowledge of data pipelines, ETL processes, and the medallion architecture. Being able to discuss these topics confidently will show that you’re ready to hit the ground running.
✨Showcase Your Problem-Solving Skills
Prepare to discuss specific challenges you've faced in previous roles and how you overcame them. Think about times when you optimised pipeline performance or implemented security measures. Real-world examples will demonstrate your hands-on experience and ability to tackle issues head-on.
✨Collaborate Like a Pro
Since this role involves working with data scientists and business stakeholders, be ready to talk about your collaboration experiences. Share examples of how you’ve partnered with others to deliver effective solutions and how you document technical designs for knowledge sharing. This will highlight your teamwork skills.
✨Ask Insightful Questions
Prepare some thoughtful questions about the company’s data strategy, team dynamics, or future projects. This shows your genuine interest in the role and helps you assess if the company is the right fit for you. Plus, it gives you a chance to engage with your interviewers on a deeper level.
