At a Glance
- Tasks: Design and build scalable data pipelines using Databricks on Azure.
- Company: Capco, a leading tech consultancy in financial services.
- Benefits: Competitive salary, health insurance, flexible holidays, and continuous learning opportunities.
- Other info: Inclusive culture that values individuality and offers excellent career growth.
- Why this job: Join a collaborative team shaping the future of digital transformation.
- Qualifications: Experience with Databricks, Python, and data pipeline development.
The predicted salary is between 60000 - 80000 £ per year.
Location: Glasgow or Edinburgh (Hybrid). Practice Area: Technology & Engineering. Type: Permanent
The Role
As a Senior Azure Data Engineer (Databricks) at Capco, you will play a hands‑on role in designing, building, and deploying scalable and secure data engineering pipelines using the Databricks platform on Azure. You’ll partner with clients to understand their data needs and develop innovative solutions that drive business transformation. You’ll also contribute to best practice implementation and continuous improvement within cross‑functional engineering teams. This role will sit in our Scotland office, with a need to potentially work in either Edinburgh or Glasgow depending on client expectations.
What You’ll Do
- Design and develop robust pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog.
- Build real‑time event‑driven solutions with tools such as Kafka and Azure Event Hubs.
- Apply DevOps principles to develop CI/CD pipelines using Azure DevOps, Jenkins, or GitHub Actions.
- Collaborate with clients and stakeholders to translate data needs into strategic technical solutions.
- Champion clean code, data lifecycle optimisation, and software engineering best practices.
What We’re Looking For
- Proven hands‑on experience with Databricks platform and orchestration.
- Strong skills in Python, PySpark, and SQL, with knowledge of distributed data systems.
- Expertise in developing full lifecycle data pipelines across ingestion, transformation, and serving layers.
- Experience with data lakehouse architecture, schema design, and GDPR‑compliant solutions.
- Working knowledge of DevOps tools and CI/CD processes.
Bonus Points For
- Development experience in Scala or Java.
- Familiarity with Cloudera, Hadoop, HIVE, and Spark ecosystem.
- Understanding of data privacy regulations, including GDPR, and experience working with sensitive data.
- Ability to learn and adapt new technologies quickly to meet business needs.
- Collaborative mindset with a passion for innovation and continuous learning.
Why Join Capco
- Deliver high‑impact technology solutions for Tier 1 financial institutions.
- Work in a collaborative, flat, and entrepreneurial consulting culture.
- Access continuous learning, training, and industry certifications.
- Be part of a team shaping the future of digital financial services.
- Help shape the future of digital transformation across FS & Energy.
Benefits
- Core Benefits: Discretionary bonus, competitive pension, health insurance, life insurance and critical illness cover.
- Mental Health: Easy access to CareFirst, Unmind, Aviva consultations, and in‑house first aiders.
- Family‑Friendly: Maternity, adoption, shared parental leave, plus paid leave for sickness, pregnancy loss, fertility treatment, menopause, and bereavement.
- Family Care: 8 complimentary backup care sessions for emergency childcare or elder care.
- Holiday Flexibility: 5 weeks of annual leave with the option to buy or sell holiday days based on your needs.
- Continuous Learning: Your growth, your way – minimum 40 hours of training annually. Take your pick; workshops, certifications, e‑learning. Also, a Business Coach assigned from Day One: Get one‑on‑one guidance to fast‑track your goals and accelerate your development.
- Extra Perks: Gympass (Wellhub), travel insurance, Tastecard, season ticket loans, Cycle to Work, and dental insurance.
Inclusion at Capco
We’re committed to making our recruitment process accessible and straightforward for everyone. If you need any adjustments at any stage, just let us know – we’ll be happy to help. We value each person’s unique perspective and contribution. At Capco, we believe that being yourself is your greatest strength. Our #BeYourselfAtWork culture encourages individuality and collaboration – a mindset that shapes how we work with clients and each other every day. Capco does not and shall not discriminate on the basis of race, color, religion (creed), gender, gender expression, age, national origin (ancestry), disability, marital status, sexual orientation, or military status, in any of its activities or operations.
Senior Azure Data Engineer (Databricks) – Hybrid UK employer: Capco
Capco is an exceptional employer that fosters a collaborative and entrepreneurial culture, making it an ideal place for Senior Azure Data Engineers to thrive. With a strong commitment to continuous learning and professional development, employees benefit from tailored training opportunities, industry certifications, and a supportive environment that values individuality. Located in the vibrant cities of Glasgow and Edinburgh, Capco offers a range of competitive benefits, including flexible holiday options and comprehensive family-friendly policies, ensuring a rewarding work-life balance.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Azure Data Engineer (Databricks) – Hybrid UK
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who work at Capco or similar companies. A friendly chat can lead to insider info about job openings and even referrals.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Databricks, Azure, and data pipelines. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Practice common interview questions related to data engineering and be ready to discuss how you've tackled challenges in past projects.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, it shows you’re genuinely interested in joining the team at Capco.
We think you need these skills to ace Senior Azure Data Engineer (Databricks) – Hybrid UK
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Senior Azure Data Engineer role. Highlight your experience with Databricks, Python, and data pipelines. We want to see how your skills match what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about this role and how your background makes you a perfect fit. We love seeing enthusiasm and a personal touch.
Showcase Your Projects:If you've worked on relevant projects, don’t hold back! Share examples of your work with data engineering, especially using tools like DeltaLake or Spark. We appreciate seeing real-world applications of your skills.
Apply Through Our Website:We encourage you to apply through our website for a smoother process. It helps us keep track of your application and ensures you get all the updates directly from us. Plus, it’s super easy!
How to prepare for a job interview at Capco
✨Know Your Tech Inside Out
Make sure you brush up on your knowledge of the Databricks platform, DeltaLake, and Spark Structured Streaming. Be ready to discuss how you've used these technologies in past projects, as well as any challenges you faced and how you overcame them.
✨Showcase Your Problem-Solving Skills
Prepare to share specific examples of how you've translated client data needs into technical solutions. Think about times when you had to innovate or adapt quickly to meet business requirements, especially in a collaborative environment.
✨Demonstrate Your DevOps Knowledge
Familiarise yourself with CI/CD processes and tools like Azure DevOps, Jenkins, or GitHub Actions. Be prepared to explain how you've implemented these practices in your previous roles and how they contributed to project success.
✨Emphasise Continuous Learning
Capco values innovation and growth, so highlight your commitment to continuous learning. Share any recent training, certifications, or new technologies you've explored, and express your enthusiasm for further development in the field.
