At a Glance
- Tasks: Lead the design and development of scalable Data Marts and cloud-native data pipelines.
- Company: Join a leading international bank driving a major cloud transformation programme.
- Benefits: Competitive daily rate, hybrid working, and potential for contract extension.
- Other info: Collaborative environment with opportunities to mentor and lead teams.
- Why this job: Be at the forefront of innovative data engineering in a high-profile project.
- Qualifications: Expertise in Databricks, cloud migrations, SQL, and Python required.
We are partnering with a leading international bank on a major Databricks-led cloud transformation programme. We are looking for a Lead Data Engineer with deep expertise in Databricks, modern data architectures and large-scale cloud migrations to help deliver a next-generation data platform.
You'll play a pivotal role in designing and building Data Marts, developing high-performance data pipelines, and migrating critical data assets from legacy Oracle environments into a scalable Databricks Lakehouse architecture that underpins finance, regulatory reporting and advanced analytics across the organisation.
- Databricks & Modern Data Platform Engineering
- Lead the design and development of scalable Data Marts using Databricks.
- Build and optimise cloud-native data pipelines using SQL and Python.
- Drive engineering best practices across CI/CD, version control, orchestration and automated deployment.
- Ensure platform performance, scalability, governance and operational excellence.
- Champion modern data engineering standards and architectural best practices.
- Oracle to Cloud Migration
- Lead the migration of data assets from legacy Oracle environments to a modern cloud-based platform.
- Define migration strategies, source-to-target mappings and data model redesign activities.
- Oversee the retirement of legacy ETL processes and implementation of cloud-native alternatives.
- Work closely with architects, DBAs and business stakeholders to ensure data quality, integrity and continuity throughout the migration programme.
- Provide technical leadership, mentoring and guidance to Data Engineers.
- Collaborate with Architecture, DevOps, Analytics, Finance and Risk teams.
- Support production releases and change management activities.
- Drive improvements in automation, monitoring, observability and platform reliability.
Proven experience delivering enterprise-scale Data Engineering solutions using Databricks or similar cloud data platforms. Strong experience designing and developing modern data architectures and Data Marts. Demonstrable experience migrating Oracle or other legacy data platforms into cloud environments. Deep understanding of data modelling, ELT/ETL design patterns and data integration principles. Advanced SQL development skills. Strong Python development experience. Experience with CI/CD pipelines, Git-based workflows and DevOps practices. Strong stakeholder management and communication skills. Banking or financial services experience. Knowledge of Master Data Management (MDM), metadata management and data governance frameworks. Experience with orchestration tools such as Azure Data Factory or Airflow.
Initial 6-month contract with strong potential for extension. Opportunity to work on a high-profile Databricks and cloud transformation programme. Hybrid working model with 3 days per week onsite in London.
BI and Data Lead employer: RedCat Digital
As a leading international bank, we pride ourselves on fostering a dynamic and inclusive work environment that champions innovation and professional growth. Our hybrid working model allows for flexibility while collaborating with talented teams on cutting-edge cloud transformation projects, providing you with the opportunity to enhance your skills in data engineering and make a significant impact within the financial sector. Join us to be part of a forward-thinking organisation that values your contributions and supports your career development.
StudySmarter Expert Advice🤫
We think this is how you could land BI and Data Lead
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who works in data engineering. You never know who might have a lead on your next big opportunity.
✨Show Off Your Skills
Don’t just talk about your experience; showcase it! Create a portfolio of projects that highlight your expertise in Databricks, SQL, and Python. This will give potential employers a tangible sense of what you can bring to the table.
✨Ace the Interview
Prepare for those interviews by brushing up on common questions related to cloud migrations and data architectures. Be ready to discuss your past projects and how you tackled challenges. Confidence is key!
✨Apply Through Us!
We’ve got your back! Make sure to apply through our website for the best chance at landing that Lead Data Engineer role. We’re here to help you every step of the way in your job search journey.
We think you need these skills to ace BI and Data Lead
Some tips for your application 🫡
Tailor Your CV:Make sure your CV speaks directly to the job description. Highlight your experience with Databricks, cloud migrations, and data engineering. We want to see how your skills align with what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for the Lead Data Engineer role. Share specific examples of your past work that relate to the responsibilities outlined in the job description.
Showcase Your Technical Skills:Don’t hold back on your technical expertise! Make sure to mention your advanced SQL and Python skills, as well as any experience with CI/CD pipelines and orchestration tools. We love seeing those details!
Apply Through Our Website:We encourage you to apply through our website for a smoother application process. It helps us keep everything organised and ensures your application gets the attention it deserves. Let’s get started!
How to prepare for a job interview at RedCat Digital
✨Know Your Databricks Inside Out
Make sure you brush up on your Databricks knowledge before the interview. Be ready to discuss your experience with building Data Marts and optimising cloud-native data pipelines using SQL and Python. Highlight specific projects where you've successfully implemented these technologies.
✨Showcase Your Migration Expertise
Prepare to talk about your experience with migrating data from legacy Oracle environments to cloud platforms. Have examples ready that demonstrate your understanding of migration strategies, source-to-target mappings, and how you’ve ensured data quality throughout the process.
✨Demonstrate Leadership Skills
Since this role involves providing technical leadership and mentoring, be prepared to share instances where you've guided teams or driven engineering best practices. Discuss how you’ve collaborated with various stakeholders, including architects and business teams, to achieve project goals.
✨Familiarise Yourself with CI/CD and DevOps Practices
As the role requires a strong grasp of CI/CD pipelines and Git-based workflows, make sure you can explain your experience with these practices. Talk about how you've implemented automation, monitoring, and observability in past projects to enhance platform reliability.
