At a Glance
- Tasks: Design and maintain data pipelines, stream telemetry, and enhance observability with cutting-edge tech.
- Company: Join a forward-thinking company in Sheffield with a hybrid work culture.
- Benefits: Competitive daily rate, flexible working, and opportunities for professional growth.
- Why this job: Make a real impact by transforming data into actionable insights and driving innovation.
- Qualifications: Experience with Kafka, OpenShift, and strong Python skills required.
- Other info: Collaborative team environment with a focus on security and best practices.
The predicted salary is between 43200 - 72000 Β£ per year.
Location: Sheffield | Hybrid - 60% office 40% home
Duration: 30/11/2026
Rate: Β£550p/d max via Umbrella
Responsibilities:
- Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale.
- Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment.
- Engineer data models and routing for multi-tenant observability; ensure lineage, quality, and SLAs across the stream layer.
- Integrate processed telemetry into Splunk for visualization, dashboards, alerting, and analytics to achieve Observability Level 4 (proactive insights).
- Implement schema management (Avro/Protobuf), governance, and versioning for telemetry events.
- Build automated validation, replay, and backfill mechanisms for data reliability and recovery.
- Instrument services with OpenTelemetry; standardize tracing, metrics, and structured logging across platforms.
- Use LLMs to enhance observability capabilities (e.g., query assistance, anomaly summarization, runbook generation).
- Collaborate with platform, SRE, and application teams to integrate telemetry, alerts, and SLOs.
- Ensure security, compliance, and best practices for data pipelines and observability platforms.
- Document data flows, schemas, dashboards, and operational runbooks.
Required Skills:
- Hands-on experience building streaming data pipelines with Kafka (producers/consumers, schema registry, Kafka Connect/KSQL/KStream).
- Proficiency with OpenShift/Kubernetes telemetry (OpenTelemetry, Prometheus) and CLI tooling.
- Experience integrating telemetry into Splunk (HEC, UF, sourcetypes, CIM), building dashboards and alerting.
- Strong data engineering skills in Python (or similar) for ETL/ELT, enrichment, and validation.
- Knowledge of event schemas (Avro/Protobuf/JSON), contracts, and backward/forward compatibility.
- Familiarity with observability standards and practices; ability to drive toward Level 4 maturity (proactive monitoring, automated insights).
- Understanding of hybrid cloud and multi-cluster telemetry patterns.
- Security and compliance for data pipelines: secret management, RBAC, encryption in transit/at rest.
- Good problem-solving skills and ability to work in a collaborative team environment.
- Strong communication and documentation skills.
Data Engineer in Sheffield employer: Experis - ManpowerGroup
Contact Detail:
Experis - ManpowerGroup Recruiting Team
StudySmarter Expert Advice π€«
We think this is how you could land Data Engineer in Sheffield
β¨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with potential colleagues on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
β¨Tip Number 2
Show off your skills! Create a portfolio showcasing your data pipelines, dashboards, and any projects you've worked on. This gives you a chance to demonstrate your expertise beyond just words on a CV.
β¨Tip Number 3
Prepare for interviews by practising common data engineering questions and scenarios. We recommend doing mock interviews with friends or using online platforms to get comfortable with the format.
β¨Tip Number 4
Apply through our website! Itβs the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Data Engineer in Sheffield
Some tips for your application π«‘
Tailor Your CV: Make sure your CV is tailored to the Data Engineer role. Highlight your experience with Kafka, OpenShift, and any relevant data engineering skills. We want to see how your background fits with what we're looking for!
Showcase Your Projects: Include specific projects where you've built data pipelines or worked with telemetry. We love seeing real examples of your work, so donβt hold back on the details that show off your skills!
Be Clear and Concise: When writing your application, keep it clear and to the point. Use bullet points for your skills and experiences to make it easy for us to read. We appreciate a well-structured application!
Apply Through Our Website: Donβt forget to apply through our website! Itβs the best way for us to receive your application and ensures youβre considered for the role. We canβt wait to hear from you!
How to prepare for a job interview at Experis - ManpowerGroup
β¨Know Your Tech Stack
Make sure youβre well-versed in the technologies mentioned in the job description, especially Kafka, OpenShift, and Splunk. Brush up on your Python skills for ETL processes and be ready to discuss how you've used these tools in past projects.
β¨Showcase Your Problem-Solving Skills
Prepare examples of how you've tackled complex data engineering challenges. Think about specific instances where you built resilient data pipelines or improved observability. This will demonstrate your ability to think critically and work collaboratively.
β¨Understand the Business Impact
Be ready to discuss how your work as a Data Engineer can drive business outcomes. Understand the importance of telemetry and observability in achieving proactive insights and how it can benefit the companyβs operations.
β¨Ask Insightful Questions
Prepare thoughtful questions about the team dynamics, current projects, and the companyβs approach to data governance and security. This shows your genuine interest in the role and helps you assess if the company is the right fit for you.