At a Glance
- Tasks: Lead the design and development of scalable Data Marts and cloud-native data pipelines.
- Company: Join a leading international bank driving a major cloud transformation programme.
- Benefits: Competitive daily rate, hybrid working model, and potential for contract extension.
- Other info: Collaborate with diverse teams and drive improvements in data platform reliability.
- Why this job: Be at the forefront of innovative data engineering in a high-profile project.
- Qualifications: Expertise in Databricks, cloud migrations, SQL, and Python required.
We are partnering with a leading international bank on a major Databricks-led cloud transformation programme. We are looking for a Lead Data Engineer with deep expertise in Databricks, modern data architectures and large-scale cloud migrations to help deliver a next-generation data platform.
You'll play a pivotal role in designing and building Data Marts, developing high-performance data pipelines, and migrating critical data assets from legacy Oracle environments into a scalable Databricks Lakehouse architecture that underpins finance, regulatory reporting and advanced analytics across the organisation.
- Databricks & Modern Data Platform Engineering
- Lead the design and development of scalable Data Marts using Databricks.
- Build and optimise cloud-native data pipelines using SQL and Python.
- Drive engineering best practices across CI/CD, version control, orchestration and automated deployment.
- Ensure platform performance, scalability, governance and operational excellence.
- Champion modern data engineering standards and architectural best practices.
- Oracle to Cloud Migration
- Lead the migration of data assets from legacy Oracle environments to a modern cloud-based platform.
- Define migration strategies, source-to-target mappings and data model redesign activities.
- Oversee the retirement of legacy ETL processes and implementation of cloud-native alternatives.
- Work closely with architects, DBAs and business stakeholders to ensure data quality, integrity and continuity throughout the migration programme.
- Provide technical leadership, mentoring and guidance to Data Engineers.
- Collaborate with Architecture, DevOps, Analytics, Finance and Risk teams.
- Support production releases and change management activities.
- Drive improvements in automation, monitoring, observability and platform reliability.
Proven experience delivering enterprise-scale Data Engineering solutions using Databricks or similar cloud data platforms. Strong experience designing and developing modern data architectures and Data Marts. Demonstrable experience migrating Oracle or other legacy data platforms into cloud environments. Deep understanding of data modelling, ELT/ETL design patterns and data integration principles. Advanced SQL development skills. Strong Python development experience. Experience with CI/CD pipelines, Git-based workflows and DevOps practices. Strong stakeholder management and communication skills. Banking or financial services experience. Knowledge of Master Data Management (MDM), metadata management and data governance frameworks. Experience with orchestration tools such as Azure Data Factory or Airflow.
Initial 6-month contract with strong potential for extension. Opportunity to work on a high-profile Databricks and cloud transformation programme. Hybrid working model with 3 days per week onsite in London.
BI & Data Team Lead employer: RedCat Digital
Join a leading international bank that prioritises innovation and employee development, offering a dynamic work culture where your expertise in Databricks and cloud migration will be pivotal to our transformative projects. With a hybrid working model, competitive daily rates, and opportunities for professional growth, you'll thrive in an environment that champions collaboration and excellence while contributing to high-impact data solutions in the financial sector.
StudySmarter Expert Advice🤫
We think this is how you could land BI & Data Team Lead
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who works in data engineering. You never know who might have a lead on that perfect job!
✨Show Off Your Skills
Create a portfolio showcasing your projects, especially those involving Databricks and cloud migrations. Share it on platforms like GitHub or LinkedIn. This way, potential employers can see your expertise in action!
✨Ace the Interview
Prepare for technical interviews by brushing up on your SQL and Python skills. Be ready to discuss your experience with cloud migrations and data architectures. Practice common interview questions and scenarios to boost your confidence!
✨Apply Through Us!
Don’t forget to check out our website for the latest job openings. Applying through us gives you a better chance of landing that role, as we’re always looking for top talent to connect with amazing companies!
We think you need these skills to ace BI & Data Team Lead
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the job description. Highlight your experience with Databricks, cloud migrations, and data engineering. We want to see how your skills match what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for the Lead Data Engineer role. Share specific examples of your past work that align with our needs.
Showcase Your Technical Skills:Don’t forget to highlight your technical expertise in SQL, Python, and cloud-native data pipelines. We love seeing concrete examples of your work, so feel free to include links to projects or GitHub repos!
Apply Through Our Website:We encourage you to apply through our website for a smoother process. It helps us keep track of applications and ensures you don’t miss out on any important updates from us!
How to prepare for a job interview at RedCat Digital
✨Know Your Databricks Inside Out
Make sure you brush up on your Databricks knowledge before the interview. Be ready to discuss your experience with building Data Marts and optimising cloud-native data pipelines using SQL and Python. Highlight specific projects where you've successfully implemented these technologies.
✨Showcase Your Migration Expertise
Prepare to talk about your experience with migrating data from legacy Oracle environments to cloud platforms. Have a clear understanding of migration strategies, source-to-target mappings, and any challenges you faced during previous migrations. This will demonstrate your capability to lead similar projects.
✨Emphasise Collaboration Skills
Since this role involves working closely with various teams, be ready to share examples of how you've collaborated with architects, DBAs, and business stakeholders in the past. Discuss how you ensured data quality and integrity during projects, as this is crucial for the role.
✨Demonstrate Your Leadership Qualities
As a Lead Data Engineer, you'll need to provide technical leadership and mentoring. Prepare to discuss your approach to guiding junior engineers and driving engineering best practices. Share specific instances where your leadership made a positive impact on a project or team.
