Lead Data Engineer in Southampton

Lead Data Engineer in Southampton

Southampton Full-Time 66150 - 80850 £ / year (est.) On-site
Quilter

At a Glance

  • Tasks: Lead the design and development of innovative data solutions that drive business value.
  • Company: Join Quilter plc, a top wealth management firm transforming financial futures.
  • Benefits: Enjoy competitive salary, private medical insurance, and generous holiday allowance.
  • Other info: Collaborative culture with opportunities for continuous learning and career growth.
  • Why this job: Be at the forefront of data engineering and make a real impact in a dynamic environment.
  • Qualifications: Experience in data engineering and strong technical leadership skills required.

The predicted salary is between 66150 - 80850 £ per year.

About the Business

Quilter plc is a leading wealth management business, helping to enable brighter financial futures for every generation. Quilter oversees £160.5 billion in customer investments (as of September 2026). It has an adviser and customer offering spanning financial advice, investment platforms, multi-asset investment solutions, and discretionary fund management.

The business is comprised of two segments: Affluent and High Net Worth. Affluent encompasses the financial planning business, Quilter Financial Planning, the Quilter Investment Platform and Quilter Investors, the multi-asset investment solutions business. High Net Worth includes the discretionary fund management business, Quilter Cheviot, together with Quilter Cheviot Financial Planning – offering a highly personalised service to private clients, charities, trustees, and professional partners. Quilter Cheviot has presence throughout the UK, Ireland and Channel Islands.

At Quilter we never stand still. Our foundations are rooted in our extraordinary expertise, which is trusted by hundreds of thousands of customers, but we have great ambitions to stay one step ahead and make an even greater difference to the people and communities we serve, including our colleagues. Our business is transforming, continually modernising, and becoming even more customer centric. So, if you want to be bold in the pursuit of your ambitions, bring new ideas, and challenge and evolve what we do, it’s the perfect time to join us.

About the Role

  • Level: 4
  • Department: COO
  • Location: Southampton or London
  • Contract type: Permanent

The role sits within the Chief Data Office (CDO) and reports to the Data Engineering Manager. This role accelerates Quilter's data strategy by providing deep, technical leadership across one or more data domains; defining engineering standards, and delivering robust, scalable and secure solutions. The Lead Data Engineer plays a pivotal role in enabling business value through the design, development, and continuous improvement of data products and platforms that support actionable insights across the organisation.

Working closely with engineers, architects, analysts, platform teams, and business stakeholders, the Lead Data Engineer is responsible for translating business requirements into robust technical solutions while driving engineering best practices and fostering a culture of technical excellence. The role requires deep technical expertise, strong problem-solving capabilities, and the ability to influence and guide both technical and non-technical stakeholders.

The key accountabilities for the role are as follows:

  • Technical Leadership & Domain Ownership
    • Provide technical leadership for one or more data domains, acting as the primary engineering authority and subject matter expert.
    • Define, champion, and evolve data engineering standards, patterns, and best practices to ensure robust, efficient, secure, and maintainable solutions.
    • Lead solution design activities and guide the implementation of scalable data pipelines, data products, and platform capabilities.
    • Review code, architecture, and engineering approaches to ensure consistency, quality, and alignment with strategic objectives.
    • Remain hands-on when required, supporting the resolution of complex technical challenges and critical delivery issues.
  • Engineering Delivery
    • Lead the technical delivery of key initiatives and ensure solutions are delivered to a high standard, meeting business requirements and engineering principles.
    • Translate business and product requirements into detailed technical designs and implementation plans.
    • Collaborate with Data Engineering Managers, Product Owners, Architects, and stakeholders to prioritise and deliver work effectively.
    • Drive adoption of modern engineering practices including automation, testing, CI/CD, source control, observability, and infrastructure-as-code.
    • Contribute to roadmap planning by identifying technical opportunities, risks, dependencies, and improvement initiatives.
  • Mentoring & Capability Development
    • Provide coaching, mentoring, and technical guidance to data engineers across the team.
    • Support the development of engineering capability through knowledge sharing, technical reviews, pair programming, and communities of practice.
    • Promote a collaborative and inclusive engineering culture focused on quality, learning, and continuous improvement.
    • Act as a role model for engineering excellence and professional standards.
  • Cross-Functional Collaboration
    • Partner with product managers, analysts, data scientists, platform teams, and business stakeholders to understand requirements and deliver valuable outcomes.
    • Work closely with architecture, platform, and governance teams to ensure solutions align with enterprise standards and strategic direction.
    • Communicate technical concepts clearly to both technical and non-technical audiences.
    • Influence decision-making by providing expert technical advice and recommendations.
  • Operational Excellence
    • Promote operational stability, reliability, and performance of data products and pipelines through monitoring, alerting, automation, and incident management practices.
    • Champion high standards of data quality, security, governance, and regulatory compliance.
    • Identify and implement opportunities to improve platform efficiency, engineering productivity, and service resilience.
    • Support root cause analysis and continuous improvement activities to enhance operational performance and service reliability.

About You

  • Qualifications
    • Degree in a technical discipline (e.g. computer science, engineering, maths, physics) or evidence of equivalent practical experience.
  • Knowledge & Experience
    • Proven experience as a senior or lead data engineer within a complex enterprise environment, delivering large-scale data solutions.
    • Strong hands-on experience designing, developing, and supporting data platforms and pipelines using Databricks within Azure.
    • Experience implementing both batch and real-time data processing solutions, including event-driven and streaming architectures.
    • Demonstrable experience leading the technical design and delivery of data products and platform capabilities across one or more business domains.
    • Experience implementing and promoting data quality frameworks, service level objectives (SLOs), data contracts, and observability tooling.
    • Strong understanding of data governance principles, including data lineage, metadata management, cataloguing, security, and access controls.
    • Experience ensuring compliance with regulatory and organisational requirements, including GDPR, data retention, and information security controls.
    • Proven ability to define technical standards, engineering patterns, and best practices and drive their adoption across engineering teams.
    • Experience mentoring and coaching engineers, conducting code reviews, and promoting engineering excellence.
    • Strong experience designing and implementing data models across multiple architectural layers, including Kimball dimensional modelling and Data Vault methodologies.
    • Experience working within Agile delivery teams and collaborating with architects, product owners, analysts, and business stakeholders to deliver business outcomes.
  • Skills
    • Strong technical leadership skills with the ability to influence engineering direction and drive best practices across teams.
    • Strategic thinker with a curious mindset, strong analytical capability, and a passion for continuous improvement.
    • Excellent problem-solving skills with the ability to resolve complex technical challenges and make sound engineering decisions.
    • Strong communication skills, with the ability to explain complex technical concepts clearly to both technical and non-technical audiences.
    • Databricks: Delta Lake, Unity Catalog, Workflows, Asset Bundles, Notebooks, Compute Management, Delta Live Tables, Spark Declarative Pipelines and platform optimisation.
    • Microsoft Fabric: Lakehouse, Data Warehouse, Real-Time Intelligence, Semantic Models, and Fabric administration concepts.
    • Azure: ADLS Gen2, Azure Data Factory, Key Vault, Functions, Azure Monitor, and broader Azure data services.
    • Spark: Deep understanding of Spark internals, distributed computing principles, optimisation techniques and features, performance tuning.
    • Languages: Advanced Python and SQL development skills; Scala experience beneficial.
    • CI/CD & DevOps: Azure DevOps, Git-based development workflows, Infrastructure as Code, automated testing, and deployment automation.
    • Orchestration: Databricks Workflows, Azure Data Factory, Fabric pipelines, and other enterprise scheduling and orchestration frameworks.
    • Data Architecture & Modelling: Strong knowledge of Kimball, Data Vault, medallion architecture, and modern lakehouse design patterns.
    • Data Governance & Security: Experience implementing secure-by-design data solutions, platform governance controls, and operational monitoring practices.

Desired Attributes

  • Passionate about engineering excellence and continuous learning.
  • Acts as a trusted technical advisor and subject matter expert within their domain.
  • Proactively identifies opportunities to improve platform capability, performance, reliability, and security.
  • Collaborative and supportive team player who enjoys mentoring others and sharing knowledge.
  • Takes ownership and accountability for technical outcomes while maintaining a pragmatic delivery-focused approach.

#LI-PM1

Inclusion & Diversity

We value diversity and strive to promote inclusivity in all aspects of our culture. We believe in equal opportunities for all, ensuring that no applicant encounters less favourable treatment based on anything but their skills, qualifications, experience, and potential. We celebrate the unique contributions of a diverse workforce and create a respectful, nurturing environment where every colleague can thrive.

Values

  • Do the right thing: We act with integrity and are proudly committed to going above and beyond in service of our clients and the support we provide our communities.
  • Always curious: We continuously seek new ideas and knowledge so we’re one step ahead of our clients’ needs. We look for inspiration everywhere and encourage experimentation, recognising that this is how we create brilliant solutions for brighter futures.
  • Embrace challenge: We aim high to transform our potential into meaningful outcomes. With ambition as our driving force and a steadfast commitment to growth, we succeed for the good of every generation.
  • Stronger together: Combining our diverse talents, we accomplish more collectively than we ever could do alone. We speak openly, actively listen, and support each other, and constructively challenge and embrace new ideas. We seek empowerment and demonstrate ownership and trust, with the confidence to make impactful decisions.

Core Benefits

  • Holiday: 182 hours (26 days)
  • Quilter Incentive Scheme: All employees are eligible to participate in incentive scheme, to incentivise business performance and their contribution.
  • Pension Scheme: A non-contributory company pension scheme that can be boosted through personal contributions.
  • Private Medical Insurance: Single cover as standard with options to increase cover to include your partner or children.
  • Life Assurance: 4x your salary.
  • Income Protection: 75% of salary, less state benefits, payable after 26 weeks of absence.
  • Healthcare Cash Plan: Jersey employees only.

In addition to our core benefits, we offer a range of flexible benefits to UK employees that you can choose from and pay for conveniently via a salary deduction.

Lead Data Engineer in Southampton employer: Quilter

Quilter plc is an exceptional employer, offering a dynamic work environment in London where innovation and collaboration thrive. With a strong commitment to employee growth, you will have the opportunity to engage with diverse teams and contribute to strategic initiatives within the asset management division. Our inclusive culture, comprehensive benefits package, and focus on integrity and curiosity make Quilter a rewarding place to build your career.

Quilter

Contact Details:

Quilter Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Lead Data Engineer in Southampton

✨Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Quilter!

✨Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Lead Data Engineer at Quilter.

✨Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Quilter.

✨Apply Directly through Our Website

When you find a suitable opening like Lead Data Engineer at Quilter, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Lead Data Engineer in Southampton

Technical Leadership
Data Engineering Standards
Data Pipeline Design
Databricks
Azure Data Factory
Real-Time Data Processing
Data Governance Principles

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at Quilter, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Quilter. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at Quilter

✨Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

✨Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

✨Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Quilter!

✨Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.