Senior Data Pipeline Engineer in London

Senior Data Pipeline Engineer in London

London Full-Time 70000 - 80000 Β£ / year (est.) No working from home possible
NETbuilder

At a Glance

  • Tasks: Design and build telemetry pipelines for enterprise observability platforms.
  • Company: Join NETbuilder, a leader in digital solutions and consulting.
  • Benefits: Competitive salary, professional development, and a supportive team culture.
  • Other info: Work in a dynamic environment with opportunities for growth and mentorship.
  • Why this job: Be a senior technical authority and make a real impact in observability.
  • Qualifications: Experience in data pipeline engineering and platform architecture required.

The predicted salary is between 70000 - 80000 Β£ per year.

Location: Brighton or London (office-based) – travel to UK client sites required

Salary: Β£70,000–£80,000 base

Role type: Full-time, permanent

Department: Technology Consulting – Observability Practice

Role Overview

NETbuilder is building an Observability Practice, and this is a senior delivery hire into it. You will join as a senior data pipeline engineer, working hands-on inside enterprise client teams to architect, deploy and operate the observability platforms and telemetry pipelines that sit at the heart of modern observability. This is primarily a hands-on delivery role – a senior individual-contributor position rather than a line-management one. Your focus is engineering across two fronts: designing and deploying the observability platforms themselves, and building the data pipelines that collect, route, transform, enrich and deliver telemetry reliably and cost-effectively across complex enterprise environments.

You will be the senior technical authority on observability platform architecture and data pipelines for the engagements you work on. While there is no permanent team to manage, on specific engagements you will provide technical leadership – mentoring junior engineers, planning the workstream and allocating tasks across the delivery team. Consulting experience is preferred but not essential – what matters most is deep, current, hands-on expertise with industry-standard observability platforms and their pipeline and transformation tooling. If you would rather solve hard data-engineering and platform problems and lead through expertise than carry permanent people-management responsibility, this is the role.

Key Responsibilities

  • Pipeline Engineering & Delivery
    • Design, build and operate telemetry pipelines that collect, route, transform, enrich, reduce and mask logs, metrics and traces at enterprise scale
    • Develop and maintain data transformation logic – parsing, restructuring, filtering and normalising telemetry across formats and schemas
    • Optimise pipelines for data quality, cost control and performance – reducing noise and volume without losing signal
    • Onboard complex applications and data sources onto observability platforms
    • Build, test and document reusable pipeline configurations, processors and templates
    • Monitor pipeline health and throughput, and troubleshoot ingestion, routing and delivery issues
  • Platform Architecture & Deployment
    • Architect observability platform deployments – topology, sizing, high availability, resilience and scaling – to meet enterprise client requirements
    • Deploy, configure and operate observability platforms and their collection/agent fleets across cloud, hybrid and on-premises environments
    • Define deployment patterns and infrastructure-as-code for repeatable, automated platform rollouts
    • Integrate observability platforms with client infrastructure, data sources and downstream destinations
    • Own platform health, upgrades and capacity planning, and keep architecture and deployment documentation current
  • Client Delivery
    • Deliver observability platform and pipeline engagements directly with enterprise clients as a senior practitioner
    • Own delivery outcomes for the platform and pipeline workstreams on assigned engagements
    • Act as senior technical authority and escalation point for platform architecture, deployment and data pipeline issues
    • Lead troubleshooting and root-cause analysis across enterprise observability platforms and telemetry pipelines
    • Support pre-sales with technical scoping and solution design for platform and pipeline work
    • Translate client requirements into platform and pipeline designs that balance coverage, cost and compliance
  • Engagement Leadership & Mentoring
    • Provide technical leadership as the senior practitioner, setting direction and quality standards for the platform and pipeline workstream
    • Plan the workstream – scope the work, sequence the tasks and allocate them across the engagement delivery team where required
    • Mentor and coach junior engineers and consultants working alongside you, sharing platform and pipeline expertise on the job
    • Co-ordinate with the wider engagement team and report progress on the workstream
  • Tooling & Practice Contribution
    • Work hands-on across the observability tool landscape, applying each platform's architecture, deployment and data-pipelining capabilities
    • Stay current with platform capabilities, roadmaps and certifications
    • Contribute to NETbuilder's platform and pipeline methodology, toolkits and reusable assets

Required Qualifications and Experience

  • Senior data pipeline engineering experience: demonstrable hands-on track record designing, building and operating telemetry/observability data pipelines at enterprise scale
  • Platform architecture and deployment experience: hands-on experience designing, deploying and operating observability platforms across cloud, hybrid and on-premises environments
  • Data transformation expertise: strong practical experience with parsing, routing, filtering, enrichment and normalisation of log, metric and trace data
  • Tooling experience: hands-on experience with the architecture, deployment and data-pipelining functionality of one or more industry-standard observability platforms
  • Engagement leadership: comfortable mentoring junior engineers and planning and allocating tasks within a delivery team on an engagement, without formal line-management authority
  • Consulting experience: preferred but not essential – comfortable working directly within enterprise client teams

Preferred Tool Experience

  • Hands-on experience with the architecture, deployment and data-pipelining functionality of one or more of the following platforms: Bindplane, Dynatrace, OpenTelemetry, Cribl, Elastic, Splunk

Preferred Certifications

  • Certification in one or more of the following is preferred: Dynatrace Professional, OpenTelemetry Certified Associate, Cribl Certified Engineer, Elastic Certified Engineer, Splunk Enterprise Certified Architect

Key Skills

  • Platform architecture and deployment: designing observability platform topology and deploying/automating platform and pipeline infrastructure as code
  • Pipeline and transformation tooling: deep expertise in one or more observability platforms and their transformation languages and processors
  • OpenTelemetry: strong working knowledge of the OpenTelemetry Collector
  • Scripting and automation: Python, Bash
  • Data formats and parsing: JSON, regex, syslog, and common log, metric and trace formats
  • Cloud platform knowledge: AWS, Azure, and/or GCP
  • Container and orchestration: Kubernetes, Docker, OpenShift
  • Familiar with delivery and project tooling: JIRA, Confluence, ServiceNow

About You

  • A hands-on engineer who would rather architect and build a solution than sit in a management meeting
  • Happy to lead through expertise – mentoring others, planning a workstream and giving direction on an engagement, even without a formal management title
  • Comfortable working directly inside enterprise client teams and engaging senior stakeholders
  • Rigorous about data quality, cost and reliability – you care about getting the right signal at the right price
  • Self-managing, delivery-focused and comfortable in a fast-moving environment
  • Naturally curious – you keep pace with a fast-evolving observability tooling landscape

About NETbuilder

NETbuilder is a leading provider of digital solutions, software, consulting and managed services. We work across multiple sectors with specialist expertise in financial services, government, and commercial markets. Since 1999 we have been providing end-to-end solutions across Digital Delivery, Development and Technology. At our core we are a Digital Transformation consultancy with capabilities for onsite, onshore and offshore delivery.

You will join a world-class team of experienced consultants, helping to build a new observability practice within the NETbuilder group.

Why NETbuilder

  • Join a new observability practice as a senior technical specialist, working with cutting-edge observability platforms
  • Work with enterprise clients across multiple sectors
  • Competitive base salary: Β£70,000–£80,000
  • Continuous investment in professional development and certification
  • High-performance, close-knit team culture where individual contribution is recognised
  • Office-based in Brighton or London, with travel to enterprise client sites

Senior Data Pipeline Engineer in London employer: NETbuilder

NETbuilder is an exceptional employer, offering a dynamic work environment where you can thrive as a Senior Data Pipeline Engineer. With a competitive salary and a strong focus on professional development, you'll have the opportunity to work with cutting-edge observability platforms while collaborating with a high-performance team that values individual contributions. The office locations in Brighton and London provide a vibrant backdrop for your career growth, alongside the chance to engage directly with enterprise clients across various sectors.

NETbuilder

Contact Details:

NETbuilder Recruitment Team

StudySmarter Expert Advice🀫

We think this is how you could land Senior Data Pipeline Engineer in London

✨Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like NETbuilder!

✨Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Senior Data Pipeline Engineer at NETbuilder.

✨Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like NETbuilder.

✨Apply Directly through Our Website

When you find a suitable opening like Senior Data Pipeline Engineer at NETbuilder, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Senior Data Pipeline Engineer in London

SQL
Problem-Solving Skills
Communication Skills
Python
Data Engineering
Data Pipeline Development
API Integration

Some tips for your application 🫑

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at NETbuilder, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at NETbuilder. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at NETbuilder

✨Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

✨Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

✨Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at NETbuilder!

✨Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.