At a Glance
- Tasks: Lead the design and development of scalable Data Marts and cloud-native data pipelines.
- Company: Join a leading international bank driving a major cloud transformation programme.
- Benefits: Competitive daily rate, hybrid working, and potential for contract extension.
- Other info: Collaborate with diverse teams and drive improvements in data engineering practices.
- Why this job: Be at the forefront of innovative data engineering in a high-profile project.
- Qualifications: Expertise in Databricks, cloud migrations, SQL, and Python required.
The predicted salary is between 46800 - 46800 £ per year.
We are partnering with a leading international bank on a major Databricks-led cloud transformation programme. We are looking for a Lead Data Engineer with deep expertise in Databricks, modern data architectures and large-scale cloud migrations to help deliver a next-generation data platform.
You'll play a pivotal role in designing and building Data Marts, developing high-performance data pipelines, and migrating critical data assets from legacy Oracle environments into a scalable Databricks Lakehouse architecture that underpins finance, regulatory reporting and advanced analytics across the organisation.
- Databricks & Modern Data Platform Engineering
- Lead the design and development of scalable Data Marts using Databricks.
- Build and optimise cloud-native data pipelines using SQL and Python.
- Drive engineering best practices across CI/CD, version control, orchestration and automated deployment.
- Ensure platform performance, scalability, governance and operational excellence.
- Champion modern data engineering standards and architectural best practices.
- Oracle to Cloud Migration
- Lead the migration of data assets from legacy Oracle environments to a modern cloud-based platform.
- Define migration strategies, source-to-target mappings and data model redesign activities.
- Oversee the retirement of legacy ETL processes and implementation of cloud-native alternatives.
- Work closely with architects, DBAs and business stakeholders to ensure data quality, integrity and continuity throughout the migration programme.
- Provide technical leadership, mentoring and guidance to Data Engineers.
- Collaborate with Architecture, DevOps, Analytics, Finance and Risk teams.
- Support production releases and change management activities.
- Drive improvements in automation, monitoring, observability and platform reliability.
Proven experience delivering enterprise-scale Data Engineering solutions using Databricks or similar cloud data platforms. Strong experience designing and developing modern data architectures and Data Marts. Demonstrable experience migrating Oracle or other legacy data platforms into cloud environments. Deep understanding of data modelling, ELT/ETL design patterns and data integration principles. Advanced SQL development skills. Strong Python development experience. Experience with CI/CD pipelines, Git-based workflows and DevOps practices. Strong stakeholder management and communication skills. Banking or financial services experience. Knowledge of Master Data Management (MDM), metadata management and data governance frameworks. Experience with orchestration tools such as Azure Data Factory or Airflow.
Initial 6-month contract with strong potential for extension. Opportunity to work on a high-profile Databricks and cloud transformation programme. Hybrid working model with 3 days per week onsite in London.
BI Data Analysis Lead employer: RedCat Digital
Join a leading international bank that prioritises innovation and employee development, offering a dynamic work culture where collaboration and excellence thrive. With a hybrid working model, you will enjoy the flexibility of working three days a week onsite in London while contributing to a high-profile Databricks-led cloud transformation programme. This role not only provides competitive compensation but also presents unique opportunities for professional growth and technical leadership in a rapidly evolving data landscape.
StudySmarter Expert Advice🤫
We think this is how you could land BI Data Analysis Lead
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who works in data engineering. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Show Off Your Skills
When you get the chance to chat with potential employers, make sure to highlight your experience with Databricks and cloud migrations. Share specific examples of projects you've worked on, especially those that involved building data pipelines or migrating from Oracle. This will help you stand out!
✨Tailor Your Approach
Before any interview, do your homework! Research the company and understand their data challenges. Tailor your answers to show how your skills in modern data architectures and CI/CD practices can help them achieve their goals. It shows you're genuinely interested and invested.
✨Apply Through Our Website
Don’t forget to check out our website for the latest job openings! Applying directly through us not only gives you a better chance but also keeps you in the loop about upcoming opportunities in the data engineering space. Let’s land that dream job together!
We think you need these skills to ace BI Data Analysis Lead
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the job description. Highlight your experience with Databricks, cloud migrations, and data engineering. We want to see how your skills match what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for the Lead Data Engineer role. Share specific examples of your past work that align with our needs.
Showcase Your Technical Skills:Don’t forget to highlight your technical skills, especially in SQL and Python. We’re keen on seeing your experience with CI/CD pipelines and cloud-native data solutions, so make sure these stand out!
Apply Through Our Website:We encourage you to apply through our website for a smoother process. It helps us keep track of your application and ensures you don’t miss any important updates from us!
How to prepare for a job interview at RedCat Digital
✨Know Your Databricks Inside Out
Make sure you brush up on your Databricks knowledge before the interview. Be ready to discuss your experience with building Data Marts and optimising cloud-native data pipelines using SQL and Python. Highlight specific projects where you've successfully implemented these technologies.
✨Showcase Your Migration Experience
Prepare to talk about your experience with migrating data from legacy Oracle environments to cloud platforms. Have examples ready that demonstrate your understanding of migration strategies, source-to-target mappings, and how you’ve ensured data quality during such transitions.
✨Demonstrate Leadership Skills
As a Lead Data Engineer, you'll need to show that you can provide technical leadership and mentor others. Think of instances where you've guided teams or driven engineering best practices. Be ready to discuss how you collaborate with various stakeholders to achieve project goals.
✨Familiarise Yourself with CI/CD and DevOps Practices
Since the role involves CI/CD pipelines and Git-based workflows, make sure you can speak confidently about your experience in these areas. Discuss any tools you've used, like Azure Data Factory or Airflow, and how they contributed to improving automation and platform reliability in your previous roles.
