At a Glance
- Tasks: Lead the design and development of scalable Data Marts and cloud-native data pipelines.
- Company: Join a leading international bank driving a major cloud transformation programme.
- Benefits: Competitive daily rate, hybrid working, and potential for contract extension.
- Other info: Collaborative environment with opportunities to mentor and lead teams.
- Why this job: Be at the forefront of innovative data engineering in a high-profile project.
- Qualifications: Expertise in Databricks, cloud migrations, SQL, and Python required.
We are partnering with a leading international bank on a major Databricks-led cloud transformation programme. We are looking for a Lead Data Engineer with deep expertise in Databricks, modern data architectures and large-scale cloud migrations to help deliver a next-generation data platform.
You'll play a pivotal role in designing and building Data Marts, developing high-performance data pipelines, and migrating critical data assets from legacy Oracle environments into a scalable Databricks Lakehouse architecture that underpins finance, regulatory reporting and advanced analytics across the organisation.
- Databricks & Modern Data Platform Engineering
- Lead the design and development of scalable Data Marts using Databricks.
- Build and optimise cloud-native data pipelines using SQL and Python.
- Drive engineering best practices across CI/CD, version control, orchestration and automated deployment.
- Ensure platform performance, scalability, governance and operational excellence.
- Champion modern data engineering standards and architectural best practices.
- Oracle to Cloud Migration
- Lead the migration of data assets from legacy Oracle environments to a modern cloud-based platform.
- Define migration strategies, source-to-target mappings and data model redesign activities.
- Oversee the retirement of legacy ETL processes and implementation of cloud-native alternatives.
- Work closely with architects, DBAs and business stakeholders to ensure data quality, integrity and continuity throughout the migration programme.
- Provide technical leadership, mentoring and guidance to Data Engineers.
- Collaborate with Architecture, DevOps, Analytics, Finance and Risk teams.
- Support production releases and change management activities.
- Drive improvements in automation, monitoring, observability and platform reliability.
Proven experience delivering enterprise-scale Data Engineering solutions using Databricks or similar cloud data platforms. Strong experience designing and developing modern data architectures and Data Marts. Demonstrable experience migrating Oracle or other legacy data platforms into cloud environments. Deep understanding of data modelling, ELT/ETL design patterns and data integration principles. Advanced SQL development skills. Strong Python development experience. Experience with CI/CD pipelines, Git-based workflows and DevOps practices. Strong stakeholder management and communication skills. Banking or financial services experience. Knowledge of Master Data Management (MDM), metadata management and data governance frameworks. Experience with orchestration tools such as Azure Data Factory or Airflow.
Initial 6-month contract with strong potential for extension. Opportunity to work on a high-profile Databricks and cloud transformation programme. Hybrid working model with 3 days per week onsite in London.
BI Data Lead employer: RedCat Digital
Join a leading international bank that prioritises innovation and employee development, offering a dynamic work culture where your expertise in Databricks and cloud migration will be pivotal to our transformative projects. With a hybrid working model, competitive daily rates, and opportunities for professional growth, you'll thrive in an environment that champions collaboration and excellence while contributing to critical financial and regulatory initiatives.
StudySmarter Expert Advice🤫
We think this is how you could land BI Data Lead
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who’s already in the role you want. Building relationships can open doors that job applications alone can't.
✨Show Off Your Skills
When you get the chance to chat with potential employers, don’t hold back! Share your experiences with Databricks, cloud migrations, and any cool projects you've worked on. Let them see how you can add value to their team.
✨Tailor Your Approach
Every company is different, so make sure you tailor your conversations to fit their needs. Research their current projects and challenges, and come prepared with ideas on how you can help them succeed in their Databricks transformation.
✨Apply Through Us!
Don’t forget to apply through our website! We’ve got loads of opportunities that match your skills, and applying directly can give you a better shot at landing that dream job. Plus, we’re here to support you every step of the way!
We think you need these skills to ace BI Data Lead
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the BI Data Lead role. Highlight your experience with Databricks, cloud migrations, and data engineering. We want to see how your skills match what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for this role. Share specific examples of your past work with data architectures and cloud platforms that relate to our needs.
Showcase Your Technical Skills:Don’t forget to highlight your technical expertise in SQL, Python, and CI/CD practices. We’re keen on seeing how you’ve applied these skills in real-world scenarios, especially in banking or financial services.
Apply Through Our Website:We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any important updates from us!
How to prepare for a job interview at RedCat Digital
✨Know Your Databricks Inside Out
Make sure you brush up on your Databricks knowledge before the interview. Be ready to discuss your experience with building Data Marts and optimising cloud-native data pipelines using SQL and Python. Highlight specific projects where you've successfully implemented these technologies.
✨Showcase Your Migration Expertise
Prepare to talk about your experience with migrating data from legacy Oracle environments to cloud platforms. Have a clear understanding of migration strategies, source-to-target mappings, and any challenges you faced during previous migrations. This will demonstrate your capability to lead similar projects.
✨Emphasise Collaboration Skills
Since this role involves working closely with various teams, be ready to share examples of how you've collaborated with architects, DBAs, and business stakeholders in the past. Discuss how you ensured data quality and integrity during projects, as this is crucial for the role.
✨Demonstrate Your Leadership Qualities
As a Lead Data Engineer, you'll need to provide technical leadership and mentoring. Prepare to discuss instances where you've guided junior engineers or driven engineering best practices. This will show that you're not just technically proficient but also a great team player.