At a Glance
- Tasks: Lead the design of a modern data platform using Databricks and improve data availability.
- Company: Established financial services organisation with a focus on data innovation.
- Benefits: Competitive daily rate, hybrid working, and the chance to shape data strategy.
- Other info: Opportunity to work with mixed teams and engage with senior stakeholders.
- Why this job: Make a real impact in transforming data analytics for a major financial player.
- Qualifications: Experience as a Lead Data Engineer in financial services and expertise in Databricks.
Lead Databricks Data Engineer
£500 - £600 per day Outside IR35
London, hybrid working
This freelance opportunity offers the chance to shape the future-state data platform for a large, complex financial services organisation. The focus is on moving from slow, batch-based analytics towards a more modern, streaming-led architecture, with clear ownership over data vision, use cases, and delivery direction.
The Company
They are a well-established organisation operating at scale within the UK financial services and pensions landscape. Managing significant volumes of legacy and live data, they work with both onshore and offshore delivery partners. The business is at a pivotal point in modernising how data is accessed, governed, and used to drive insight. Clear communication and pragmatic decision-making are highly valued.
The Role and Deliverables
- Define a clear end-to-end data vision, covering current state, target architecture, and practical steps to get there.
- Lead the design and development of a Databricks-based medallion architecture, with a strong focus on a robust Gold layer for analytics.
- Improve data availability by shifting from monthly batch processes towards more frequent or streaming ingestion where appropriate.
- Act as the senior technical decision-maker on data use cases, prioritisation, and trade-offs.
- Work closely with onshore teams and an offshore partner to unblock progress, clarify ownership, and accelerate delivery.
- Provide regular, clear updates to senior stakeholders, ensuring alignment on progress and next steps.
Your Skills & Experience
- Strong experience as a Lead Data Engineer within financial services, ideally pensions or a similarly regulated environment.
- Proven capability designing and delivering modern data platforms using Databricks and medallion architecture principles.
- Experience dealing with large volumes of legacy data and integrating it with modern analytics platforms.
- Confidence defining data use cases and translating business needs into technical delivery.
- Ability to lead mixed teams across onshore and offshore models and make effective resource allocation decisions.
- Excellent communication skills, with the credibility to engage senior stakeholders and drive momentum.
Databricks Data Engineer employer: Harnham
Join a leading UK-based media organisation at the forefront of digital transformation, where your role as Director of Streaming Product and Growth will be pivotal in shaping the future of their subscription services. With a strong emphasis on innovation and a collaborative work culture, you'll have access to significant growth opportunities, competitive salary packages, and a performance-based bonus structure, all while working in a dynamic environment that values data-driven decision making and customer-centric strategies.
StudySmarter Expert Advice🤫
We think this is how you could land Databricks Data Engineer
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Harnham!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Databricks Data Engineer at Harnham.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Harnham.
✨Apply Directly through Our Website
When you find a suitable opening like Databricks Data Engineer at Harnham, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at Harnham, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Harnham. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at Harnham
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Harnham!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.
