Data Pipeline Engineers in London

Data Pipeline Engineers in London

London Full-Time 70000 - 80000 £ / year (est.) Home office (partial)
NETbuilder

At a Glance

  • Tasks: Design and build observability platforms and data pipelines for enterprise clients.
  • Company: Join NETbuilder, a leader in digital solutions and technology consulting.
  • Benefits: Competitive salary, professional development, and a collaborative culture.
  • Other info: Hybrid role with opportunities for mentorship and technical leadership.
  • Why this job: Shape the future of observability while solving complex engineering challenges.
  • Qualifications: Experience in data pipeline engineering and observability platform architecture.

The predicted salary is between 70000 - 80000 £ per year.

Location: Hybrid – based from either our Brighton or London office, with travel to UK client sites as required.

Full-time, permanent.

Technology Consulting – Observability Practice.

NETbuilder is building an Observability Practice, and this is a senior delivery hire into it.

As a Senior Data Pipeline Engineer, you will work hands-on with enterprise clients to architect, deploy and operate the observability platforms and telemetry data pipelines that power modern observability. You will work extensively with technologies such as OpenTelemetry, Dynatrace OpenPipeline, Bindplane, Cribl, Elastic and Splunk, helping enterprise organisations collect, transform and route logs, metrics and traces reliably, efficiently and at scale.

You will be responsible for both the observability platform itself and the telemetry pipelines that collect, transform, enrich and route operational data across complex enterprise environments. This is primarily a senior individual contributor position rather than a permanent people-management role. You'll remain hands-on while providing technical leadership on client engagements—mentoring engineers, planning workstreams and acting as the senior technical authority for observability platforms and telemetry pipelines.

What matters most is strong, current, hands-on experience designing observability platforms and building telemetry data pipelines within complex enterprise environments. If you enjoy solving challenging engineering problems, designing scalable observability architectures and leading through technical expertise, this is the role for you.

Pipeline Engineering & Delivery:
  • Develop and maintain data transformation logic – parsing, restructuring, filtering and normalising telemetry across formats and schemas.
  • Optimise pipelines for data quality, cost control and performance – reducing noise and volume without losing signal.
  • Onboard complex applications and data sources onto observability platforms.
  • Build, test and document reusable pipeline configurations, processors and templates.
Platform Architecture & Deployment:
  • Architect observability platform deployments – topology, sizing, high availability, resilience and scaling – to meet enterprise client requirements.
  • Deploy, configure and operate observability platforms and their collection/agent fleets across cloud, hybrid and on-premises environments.
  • Define deployment patterns and infrastructure-as-code for repeatable, automated platform rollouts.
  • Integrate observability platforms with client infrastructure, data sources and downstream destinations.
  • Own platform health, upgrades and capacity planning, and keep architecture and deployment documentation current.
  • Act as senior technical authority and escalation point for platform architecture, deployment and data pipeline issues.
  • Lead troubleshooting and root-cause analysis across enterprise observability platforms and telemetry pipelines.

This is engagement-scoped technical leadership rather than permanent line management – on specific engagements you will:

  • Provide technical leadership as the senior practitioner, setting direction and quality standards for the platform and pipeline workstream.
  • Mentor and coach junior engineers and consultants working alongside you, sharing platform and pipeline expertise on the job.
  • Work hands-on across the observability tool landscape, applying each platform's architecture, deployment and data-pipelining capabilities.
  • Contribute to NETbuilder's platform and pipeline methodology, toolkits and reusable assets.
Senior data pipeline engineering experience: demonstrable hands-on track record designing, building and operating telemetry/observability data pipelines at enterprise scale.
Platform architecture and deployment experience: hands-on experience designing, deploying and operating observability platforms (topology, sizing, high availability and scaling) across cloud, hybrid and on-premises environments.
Data transformation expertise: strong practical experience with parsing, routing, filtering, enrichment and normalisation of log, metric and trace data.
Tooling experience: hands-on experience with the architecture, deployment and data-pipelining functionality of one or more industry-standard observability platforms.
Engagement leadership: comfortable mentoring junior engineers and planning and allocating tasks within a delivery team on an engagement, without formal line-management authority.
Hands-on experience: with the architecture, deployment and data-pipelining functionality of one or more of the following platforms, in order of preference:
  • Platform architecture and deployment: designing observability platform topology (sizing, HA, scaling) and deploying/automating platform and pipeline infrastructure as code.
  • Pipeline and transformation tooling: deep expertise in one or more observability platforms and their transformation languages and processors.
  • Python, Bash.
  • Data formats and parsing: AWS, Azure, and/or GCP.
  • Familiar with delivery and project tooling: JIRA, Confluence, ServiceNow.

Happy to lead through expertise – mentoring others, planning a workstream and giving direction on an engagement, even without a formal management title. Comfortable working directly with enterprise client teams and engaging senior stakeholders in a hybrid role, based from either our Brighton or London office with travel to UK client sites as required.

Rigorous about data quality, cost and reliability – you care about getting the right signal at the right price.

NETbuilder is a leading provider of digital solutions, consulting, software engineering and managed services. We deliver complex technology solutions across financial services, government and commercial markets. Since 1999, we've helped organisations deliver digital transformation through specialist expertise in software development, consulting and technology delivery.

You'll join an experienced team of consultants and play a key role in building NETbuilder's new Observability Practice from the ground up. Join a brand-new Observability Practice and help shape its technical direction.

Competitive base salary of £70,000–£80,000. Ongoing investment in professional development and certifications. High-performing, collaborative engineering culture where technical expertise is recognised. Hybrid working from either our Brighton or London office, with travel to UK client sites as required.

Data Pipeline Engineers in London employer: NETbuilder

NETbuilder is an exceptional employer, offering a dynamic hybrid work environment from our Brighton or London offices, where you can thrive in a high-performing, collaborative engineering culture. With a strong commitment to professional development and competitive salaries, we empower our Senior Data Pipeline Engineers to lead technical initiatives while mentoring others, ensuring that your expertise is recognised and valued as we build our new Observability Practice together.

NETbuilder

Contact Details:

NETbuilder Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Data Pipeline Engineers in London

Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like NETbuilder!

Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Data Pipeline Engineers at NETbuilder.

Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like NETbuilder.

Apply Directly through Our Website

When you find a suitable opening like Data Pipeline Engineers at NETbuilder, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Data Pipeline Engineers in London

SQL
Python
Problem-Solving Skills
Communication Skills
Data Engineering
Data Pipeline Development
API Integration

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at NETbuilder, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at NETbuilder. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at NETbuilder

Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at NETbuilder!

Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.