At a Glance
- Tasks: Lead the design of a modern data platform using Databricks and medallion architecture.
- Company: Established financial services organisation transforming data access and governance.
- Benefits: Competitive daily rate, flexible working, and impactful project ownership.
- Other info: Opportunity to work with onshore and offshore teams for career growth.
- Why this job: Shape the future of data analytics in a dynamic financial environment.
- Qualifications: Experience as a Lead Data Engineer in financial services and expertise in Databricks.
Lead Databricks Engineer
London, This freelance opportunity offers the chance to shape the future-state data platform for a large, complex financial services organisation.
The focus is on moving from slow, batch-based analytics towards a more modern, streaming-led architecture, with clear ownership over data vision, use cases, and delivery direction.
The Company
They are a well-established organisation operating at scale within the UK financial services and pensions landscape.
Managing significant volumes of legacy and live data, they work with both onshore and offshore delivery partners.
The business is at a pivotal point in modernising how data is accessed, governed, and used to drive insight.
Clear communication and pragmatic decision-making are highly valued.
The Role and Deliverables
- Define a clear end-to-end data vision, covering current state, target architecture, and practical steps to get there.
- Lead the design and development of a Databricks-based medallion architecture, with a strong focus on a robust Gold layer for analytics.
- Improve data availability by shifting from monthly batch processes towards more frequent or streaming ingestion where appropriate.
- Act as the senior technical decision-maker on data use cases, prioritisation, and trade-offs.
- Work closely with onshore teams and an offshore partner to unblock progress, clarify ownership, and accelerate delivery.
- Provide regular, clear updates to senior stakeholders, ensuring alignment on progress and next steps.
- Your Skills & Experience
- Strong experience as a Lead Data Engineer within financial services, ideally pensions or a similarly regulated environment.
- Proven capability designing and delivering modern data platforms using Databricks and medallion architecture principles.
- Experience dealing with large volumes of legacy data and integrating it with modern analytics platforms.
- Confidence defining data use cases and translating business needs into technical delivery.
- Ability to lead mixed teams across onshore and offshore models and make effective resource allocation decisions.
- Excellent communication skills, with the credibility to engage senior stakeholders and drive momentum.
Lead Databricks Engineer in London employer: Harnham - Data & Analytics Recruitment Careers
As a leading consumer retail organisation based in London, we pride ourselves on fostering a dynamic and inclusive work culture that champions innovation and collaboration. Our commitment to employee growth is evident through tailored development programmes and the opportunity to lead transformative digital initiatives, all while enjoying a competitive salary and bonus structure. Join us to be part of a forward-thinking team that values your contributions and empowers you to drive meaningful change in a rapidly evolving market.
Contact Details:
Harnham - Data & Analytics Recruitment Careers Recruitment Team
StudySmarter Expert Advice🤫
We think this is how you could land Lead Databricks Engineer in London
✨Showcase Your Skills with a Public Portfolio
As a freelancer in data science, having a killer portfolio is essential. Showcase your projects on platforms like GitHub or create a personal website that details your work and techniques. This gives potential clients a clear picture of what you can do and helps you stand out from the competition.
✨Get Involved in Data Science Communities
Tap into online forums like Kaggle or Stack Overflow. Not only can you showcase your expertise, but you can also connect with other data scientists and potential clients. Plus, participating in competitions and discussions can elevate your profile in the field.
✨Leverage Local Networking Opportunities
Keep an eye out for local data science meetups or tech events in your area. These are golden opportunities to meet potential clients and collaborators face-to-face. Plus, who doesn't love a bit of networking over pizza and drinks?
✨Pitch Your Services Directly to Companies
Don't just wait for freelancing platforms to bring clients to you—be proactive! Research companies that could benefit from data science services and craft tailored pitches. Mention specific pain points you can address for them. Let’s get that freelance hustle going!
We think you need these skills to ace Lead Databricks Engineer in London
Some tips for your application 🫡
Showcase Your Projects:When applying for a freelance data science role like Lead Databricks Engineer at Harnham - Data & Analytics Recruitment Careers, it’s crucial to highlight your projects. Include a portfolio that features at least two or three projects involving data analysis, machine learning, or visualisation. Make sure to describe the tools and methodologies you used, so we can see your skills in action!
Quantify Your Achievements:Freelance gigs, especially in data science, often ask for proven results. In your CV, include any relevant metrics or outcomes from your previous work. Did your analysis help reduce costs by a certain percentage? Or did your predictive model improve performance? Numbers speak volumes!
Introduce Your Style:Since freelancing is all about your individual style and approach, use your cover letter to share how you tackle data problems. This is your chance to let us know how you think, your creative problem-solving methods, and how you would approach a project at Harnham - Data & Analytics Recruitment Careers.
Be Real About Your Rates:When you send in your application, don’t forget to mention your freelance rates and availability. We appreciate clarity up front, and it helps us gauge if you fit within our budget and timeline. Being transparent in this aspect shows professionalism and readiness!
How to prepare for a job interview at Harnham - Data & Analytics Recruitment Careers
✨Show Off Your Data Wizardry
As a freelancer in data science, you'll want to present a portfolio that showcases your best projects. We should pull together examples where you tackled real problems with data analytics, machine learning models, or visualisations. It's all about demonstrating your skills in action!
✨Be Ready to Dive Deep into Technical Questions
Expect to encounter some technical grilling during the interview. Prepare to discuss statistical methods, algorithms, or maybe even tackle a live coding challenge. We should brush up on tools like Python, R, or SQL—those are key players in the data science field. Don't just know them; be ready to explain your thought process!
✨Help Them Understand Your Work Style
Freelance gigs often mean you'll be working independently, so we need to convey our self-motivation and time management skills. Be prepared to talk about how you’ve handled multiple projects or met tight deadlines before. Sharing your approach to client communication can also give them confidence in your ability to deliver remotely.
✨Pitch Your Value Proposition
When freelancing, it’s crucial to clearly articulate what makes you unique. We should highlight not just technical skills but also the business impact of our projects. Think of a couple of stories where your data insights drove decision-making—this can be a game changer in showing why they should choose you for their freelance needs!