Data Engineer in Sheffield

Data Engineer in Sheffield

Sheffield Full-Time 43200 - 72000 Β£ / year (est.) Home office (partial)
E

At a Glance

  • Tasks: Design and maintain data pipelines, stream telemetry, and enhance observability with cutting-edge tech.
  • Company: Join a forward-thinking company in Sheffield with a hybrid work culture.
  • Benefits: Competitive daily rate, flexible working, and opportunities for professional growth.
  • Why this job: Make a real impact by transforming data into actionable insights and driving innovation.
  • Qualifications: Experience with Kafka, OpenShift, and strong Python skills required.
  • Other info: Collaborative team environment with a focus on security and best practices.

The predicted salary is between 43200 - 72000 Β£ per year.

Location: Sheffield | Hybrid - 60% office 40% home

Duration: 30/11/2026

Rate: Β£550p/d max via Umbrella

Responsibilities:

  • Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale.
  • Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment.
  • Engineer data models and routing for multi-tenant observability; ensure lineage, quality, and SLAs across the stream layer.
  • Integrate processed telemetry into Splunk for visualization, dashboards, alerting, and analytics to achieve Observability Level 4 (proactive insights).
  • Implement schema management (Avro/Protobuf), governance, and versioning for telemetry events.
  • Build automated validation, replay, and backfill mechanisms for data reliability and recovery.
  • Instrument services with OpenTelemetry; standardize tracing, metrics, and structured logging across platforms.
  • Use LLMs to enhance observability capabilities (e.g., query assistance, anomaly summarization, runbook generation).
  • Collaborate with platform, SRE, and application teams to integrate telemetry, alerts, and SLOs.
  • Ensure security, compliance, and best practices for data pipelines and observability platforms.
  • Document data flows, schemas, dashboards, and operational runbooks.

Required Skills:

  • Hands-on experience building streaming data pipelines with Kafka (producers/consumers, schema registry, Kafka Connect/KSQL/KStream).
  • Proficiency with OpenShift/Kubernetes telemetry (OpenTelemetry, Prometheus) and CLI tooling.
  • Experience integrating telemetry into Splunk (HEC, UF, sourcetypes, CIM), building dashboards and alerting.
  • Strong data engineering skills in Python (or similar) for ETL/ELT, enrichment, and validation.
  • Knowledge of event schemas (Avro/Protobuf/JSON), contracts, and backward/forward compatibility.
  • Familiarity with observability standards and practices; ability to drive toward Level 4 maturity (proactive monitoring, automated insights).
  • Understanding of hybrid cloud and multi-cluster telemetry patterns.
  • Security and compliance for data pipelines: secret management, RBAC, encryption in transit/at rest.
  • Good problem-solving skills and ability to work in a collaborative team environment.
  • Strong communication and documentation skills.

Data Engineer in Sheffield employer: Experis - ManpowerGroup

As a Data Engineer at our Sheffield location, you will thrive in a dynamic hybrid work environment that promotes collaboration and innovation. We offer competitive rates, a strong focus on employee growth through continuous learning opportunities, and a supportive culture that values your contributions. Join us to be part of a forward-thinking team dedicated to pushing the boundaries of data engineering and observability.
E

Contact Detail:

Experis - ManpowerGroup Recruiting Team

StudySmarter Expert Advice 🀫

We think this is how you could land Data Engineer in Sheffield

✨Tip Number 1

Network like a pro! Reach out to folks in the industry, attend meetups, and connect with potential colleagues on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.

✨Tip Number 2

Show off your skills! Create a portfolio showcasing your data pipelines, dashboards, and any projects you've worked on. This gives you a chance to demonstrate your expertise beyond just words on a CV.

✨Tip Number 3

Prepare for interviews by practising common data engineering questions and scenarios. We recommend doing mock interviews with friends or using online platforms to get comfortable with the format.

✨Tip Number 4

Apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!

We think you need these skills to ace Data Engineer in Sheffield

Data Pipeline Development
Kafka (Producers/Consumers, Schema Registry, Kafka Connect/KSQL/KStream)
OpenShift/Kubernetes Telemetry
OpenTelemetry
Prometheus
Splunk Integration (HEC, UF, Sourcetypes, CIM)
Python (or similar) for ETL/ELT
Event Schemas (Avro/Protobuf/JSON)
Observability Standards and Practices
Hybrid Cloud and Multi-Cluster Telemetry Patterns
Security and Compliance for Data Pipelines
Problem-Solving Skills
Collaboration Skills
Communication and Documentation Skills

Some tips for your application 🫑

Tailor Your CV: Make sure your CV is tailored to the Data Engineer role. Highlight your experience with Kafka, OpenShift, and any relevant data engineering skills. We want to see how your background fits with what we're looking for!

Showcase Your Projects: Include specific projects where you've built data pipelines or worked with telemetry. We love seeing real examples of your work, so don’t hold back on the details that show off your skills!

Be Clear and Concise: When writing your application, keep it clear and to the point. Use bullet points for your skills and experiences to make it easy for us to read. We appreciate a well-structured application!

Apply Through Our Website: Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to hear from you!

How to prepare for a job interview at Experis - ManpowerGroup

✨Know Your Tech Stack

Make sure you’re well-versed in the technologies mentioned in the job description, especially Kafka, OpenShift, and Splunk. Brush up on your Python skills for ETL processes and be ready to discuss how you've used these tools in past projects.

✨Showcase Your Problem-Solving Skills

Prepare examples of how you've tackled complex data engineering challenges. Think about specific instances where you built resilient data pipelines or improved observability. This will demonstrate your ability to think critically and work collaboratively.

✨Understand the Business Impact

Be ready to discuss how your work as a Data Engineer can drive business outcomes. Understand the importance of telemetry and observability in achieving proactive insights and how it can benefit the company’s operations.

✨Ask Insightful Questions

Prepare thoughtful questions about the team dynamics, current projects, and the company’s approach to data governance and security. This shows your genuine interest in the role and helps you assess if the company is the right fit for you.

Data Engineer in Sheffield
Experis - ManpowerGroup
Location: Sheffield

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

E
Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>