At a Glance
- Tasks: Lead the design and development of scalable Data Marts and cloud-native data pipelines.
- Company: Join a leading international bank driving a major cloud transformation programme.
- Benefits: Competitive daily rate, hybrid working, and potential for contract extension.
- Other info: Collaborate with diverse teams and drive improvements in data engineering practices.
- Why this job: Be at the forefront of innovative data engineering in a high-profile project.
- Qualifications: Expertise in Databricks, cloud migrations, SQL, and Python required.
The predicted salary is between 52000 - 78000 £ per year.
We are partnering with a leading international bank on a major Databricks-led cloud transformation programme. We are looking for a Lead Data Engineer with deep expertise in Databricks, modern data architectures and large-scale cloud migrations to help deliver a next-generation data platform.
You'll play a pivotal role in designing and building Data Marts, developing high-performance data pipelines, and migrating critical data assets from legacy Oracle environments into a scalable Databricks Lakehouse architecture that underpins finance, regulatory reporting and advanced analytics across the organisation.
- Databricks & Modern Data Platform Engineering
- Lead the design and development of scalable Data Marts using Databricks.
- Build and optimise cloud-native data pipelines using SQL and Python.
- Drive engineering best practices across CI/CD, version control, orchestration and automated deployment.
- Ensure platform performance, scalability, governance and operational excellence.
- Champion modern data engineering standards and architectural best practices.
- Oracle to Cloud Migration
- Lead the migration of data assets from legacy Oracle environments to a modern cloud-based platform.
- Define migration strategies, source-to-target mappings and data model redesign activities.
- Oversee the retirement of legacy ETL processes and implementation of cloud-native alternatives.
- Work closely with architects, DBAs and business stakeholders to ensure data quality, integrity and continuity throughout the migration programme.
- Provide technical leadership, mentoring and guidance to Data Engineers.
- Collaborate with Architecture, DevOps, Analytics, Finance and Risk teams.
- Support production releases and change management activities.
- Drive improvements in automation, monitoring, observability and platform reliability.
Proven experience delivering enterprise-scale Data Engineering solutions using Databricks or similar cloud data platforms. Strong experience designing and developing modern data architectures and Data Marts. Demonstrable experience migrating Oracle or other legacy data platforms into cloud environments. Deep understanding of data modelling, ELT/ETL design patterns and data integration principles. Advanced SQL development skills. Strong Python development experience. Experience with CI/CD pipelines, Git-based workflows and DevOps practices. Strong stakeholder management and communication skills. Banking or financial services experience. Knowledge of Master Data Management (MDM), metadata management and data governance frameworks. Experience with orchestration tools such as Azure Data Factory or Airflow.
Initial 6-month contract with strong potential for extension. Opportunity to work on a high-profile Databricks and cloud transformation programme. Hybrid working model with 3 days per week onsite in London.
Data and BI Lead employer: RedCat Digital
Join a leading international bank that prioritises innovation and employee development, offering a dynamic work culture where your expertise in Databricks and cloud migration will be valued. With a hybrid working model, you can enjoy the flexibility of working from home while collaborating with talented professionals in London, all while contributing to a high-profile cloud transformation programme that promises significant career growth opportunities.
StudySmarter Expert Advice🤫
We think this is how you could land Data and BI Lead
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even just grab a coffee with someone who works in data engineering. You never know who might have a lead on that perfect job!
✨Show Off Your Skills
Create a portfolio showcasing your projects, especially those involving Databricks and cloud migrations. Share it on platforms like GitHub or LinkedIn. This way, potential employers can see your expertise in action!
✨Ace the Interview
Prepare for technical interviews by brushing up on your SQL and Python skills. Be ready to discuss your experience with cloud migrations and data architectures. Practice common interview questions and scenarios to boost your confidence!
✨Apply Through Us!
Don’t forget to check out our website for the latest job openings. Applying through StudySmarter gives you an edge, as we’re always looking to connect talented individuals with top companies in the industry!
We think you need these skills to ace Data and BI Lead
Some tips for your application 🫡
Tailor Your CV:Make sure your CV speaks directly to the job description. Highlight your experience with Databricks, cloud migrations, and data engineering. We want to see how your skills align with what we're looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for the Lead Data Engineer role. Share specific examples of your past work that relate to the responsibilities outlined in the job description.
Showcase Your Technical Skills:Don’t hold back on showcasing your technical expertise! Mention your experience with SQL, Python, and any orchestration tools you've used. We love seeing candidates who can demonstrate their hands-on skills in data engineering.
Apply Through Our Website:We encourage you to apply through our website for a smoother application process. It helps us keep track of your application and ensures you don’t miss out on any important updates from us!
How to prepare for a job interview at RedCat Digital
✨Know Your Databricks Inside Out
Make sure you brush up on your Databricks knowledge before the interview. Be ready to discuss your experience with building Data Marts and optimising data pipelines using SQL and Python. Highlight specific projects where you've successfully implemented these technologies.
✨Showcase Your Migration Expertise
Prepare to talk about your experience with migrating data from legacy Oracle environments to cloud platforms. Have a clear understanding of migration strategies, source-to-target mappings, and how you've ensured data quality during such transitions.
✨Demonstrate Leadership Skills
Since this role involves providing technical leadership and mentoring, be ready to share examples of how you've guided teams in best practices for data engineering. Discuss any experiences where you've collaborated with cross-functional teams to drive improvements in automation and platform reliability.
✨Communicate Effectively
Strong communication skills are key for this position. Practice articulating complex technical concepts in a way that's easy to understand. Be prepared to discuss how you've managed stakeholders and ensured alignment across different teams in previous roles.
