At a Glance
- Tasks: Design and maintain cloud-based data infrastructure using Azure and Databricks.
- Company: Join a leading tech firm focused on innovative data solutions.
- Benefits: Attractive salary, flexible working options, and opportunities for professional growth.
- Other info: Collaborative environment with a focus on cutting-edge technology.
- Why this job: Be at the forefront of data engineering and make a significant impact.
- Qualifications: 5+ years in Azure services and strong Databricks experience required.
The predicted salary is between 60000 - 80000 € per year.
We are seeking an experienced Data Engineer to design, build, and maintain our cloud-based data infrastructure on Azure and Databricks. This role is pivotal in ensuring our data platform is scalable, secure, and optimised for advanced analytics and reporting.
Key Responsibilities
- Platform Development & Maintenance
- Design and implement robust data pipelines using Azure Data Factory, Databricks, and related Azure services.
- Build ETL/ELT processes to transform raw data into structured, analytics-ready formats.
- Optimise pipeline performance, ensure data quality, and maintain high availability of data services.
- Infrastructure & Architecture
- Architect and deploy scalable data lake solutions using Azure Data Lake Storage.
- Implement data governance and security measures aligned with compliance standards.
- Use Infrastructure-as-Code tools (e.g., Terraform) for reproducible deployments.
- Define best practices for data organisation, partitioning, and storage optimisation.
- Databricks Development
- Develop and optimise jobs within Databricks, leveraging Delta Lake for reliable storage and ACID transactions.
- Implement medallion architecture (bronze, silver, gold layers) and reusable notebooks.
- Optimise cluster configurations for cost and performance.
- Establish CI/CD pipelines for Databricks deployments.
- Monitoring & Operations
- Implement monitoring and alerting solutions using Azure Monitor, Log Analytics, and Databricks tools.
- Troubleshoot performance issues, optimise resource utilisation, and ensure SLAs are met.
- Define disaster recovery procedures and backup strategies.
- Collaboration & Documentation
- Partner with data scientists, analysts, and business stakeholders to deliver tailored data solutions.
- Document technical architectures, data flows, and operational procedures for knowledge sharing.
Essential Skills & Experience
- 5+ years of experience with Azure Cloud services (Data Factory, Data Lake Storage, SQL Database, Synapse Analytics).
- Strong hands-on experience with Databricks, Delta Lake, and cluster management.
- Proficiency in SQL and Python for data manipulation and pipeline development.
- Experience with Git/GitHub and CI/CD practices.
- Solid understanding of data modelling concepts and data lake architectures.
- Knowledge of data governance, security, and compliance requirements.
Desirable Skills
- Experience with Terraform or other Infrastructure-as-Code tools.
- Familiarity with Azure DevOps or similar CI/CD platforms.
- Exposure to data quality frameworks and testing approaches.
- Azure certification (e.g., Azure Data Engineer Associate).
- Databricks certification.
Databricks Engineer in London employer: McCabe & Barton
Join a forward-thinking company that values innovation and collaboration, where as a Databricks Engineer, you will play a crucial role in shaping our cloud-based data infrastructure. We offer a dynamic work culture that fosters professional growth through continuous learning opportunities and access to cutting-edge technologies, all while enjoying the benefits of a supportive team environment in a prime location. With a commitment to employee well-being and development, we ensure that your contributions are recognised and rewarded, making this an exceptional place to advance your career.
StudySmarter Expert Advice🤫
We think this is how you could land Databricks Engineer in London
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field, especially those who work with Azure and Databricks. A friendly chat can lead to insider info about job openings that aren't even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Azure Data Factory and Databricks. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge. Be ready to discuss your experience with ETL processes, data lake architectures, and CI/CD practices. We want you to shine when it comes to demonstrating your expertise!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive and engaged with our platform.
We think you need these skills to ace Databricks Engineer in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV speaks directly to the job description. Highlight your experience with Azure, Databricks, and any relevant projects you've worked on. We want to see how your skills align with what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to tell us why you're passionate about data engineering and how you can contribute to our team. Be sure to mention specific technologies and experiences that relate to the role.
Showcase Your Projects:If you've worked on any cool data projects, don't hold back! Include links to your GitHub or any relevant portfolios. We love seeing practical examples of your work, especially with Databricks and Azure services.
Apply Through Our Website:We encourage you to apply through our website for the best chance of getting noticed. It helps us keep track of applications and ensures you’re considered for the role. Plus, it’s super easy!
How to prepare for a job interview at McCabe & Barton
✨Know Your Tech Inside Out
Make sure you’re well-versed in Azure services, Databricks, and the tools mentioned in the job description. Brush up on your SQL and Python skills, and be ready to discuss how you've used them in past projects. The more specific examples you can provide, the better!
✨Showcase Your Problem-Solving Skills
Prepare to discuss how you've tackled challenges in data pipeline development or optimised performance in previous roles. Think of a few scenarios where you implemented solutions that improved efficiency or data quality, and be ready to share those stories.
✨Understand the Medallion Architecture
Since the role involves implementing medallion architecture, make sure you can explain what it is and how you’ve applied it in your work. Be prepared to discuss the benefits of bronze, silver, and gold layers in data processing and how they contribute to a robust data strategy.
✨Ask Insightful Questions
Interviews are a two-way street! Prepare thoughtful questions about the company’s data strategy, team dynamics, or future projects. This shows your genuine interest in the role and helps you gauge if the company is the right fit for you.
