Data Analytics Engineer
Job Overview
We are seeking an experienced Data Analytics Engineer to lead the migration, optimization, and secure operation of our log ingestion and observability pipelines. The role emphasizes secure data delivery, advanced SIEM coverage, Splunk expertise, data reduction strategies, and robust load balancing and high availability for log infrastructure.
Key Responsibilities
End-to-End SIEM Pipeline Management & Optimization
Lead the migration of log sources from Splunk ingestion to Cribl Stream/Edge pipelines, ensuring load-balanced, fault-tolerant delivery and processing of security and IT logs.
Architect and manage scalable, resilient pipelines—including design, implementation, and operation of load balancing solutions (e.g., Cribl worker groups, external load balancers, or syslog load distribution) for high ingest volumes.
Analyze, tune and securely onboard all log sources (firewalls, EDR, cloud, authentication, proxies, etc.)—covering parsing, filtering, and data reduction techniques to minimize Splunk ingest/storage costs without sacrificing security coverage.
Develop and maintain Cribl and Splunk configurations, including advanced transformations, field normalization, masking, and enrichment for security analytics.
Ensure optimal distribution of logging workload across Cribl worker nodes and Splunk indexers to prevent bottlenecks, data loss, or single points of failure.
Security Event Visibility and SOC Enablement
Collaborate with SOC, IR, and threat detection teams to ensure all security logs reach the SIEM efficiently and reliably, and logs are tuned for actionable detection.
Actively monitor, test, and remediate pipeline balancing and ingestion health to maximize uptime and forensic visibility.
Respond to and resolve SIEM and pipeline issues that impact security, detection, or compliance visibility.
Governance, Compliance & Documentation
Apply and document security policies for log routing, load balancing, event retention, and integrity—ensuring pipeline architecture meets audit, legal, and privacy requirements.
Track and report ingest reduction, Splunk cost savings, pipeline health, and event loss/drop rates across the load-balanced infrastructure.
Maintain clear, up-to-date documentat...
Data Analytics Engineer employer: INTEC SELECT LIMITED Careers
As a leading global organisation, we pride ourselves on fostering a dynamic and inclusive work culture that empowers our employees to thrive. Our London-based team enjoys the flexibility of a hybrid working model, competitive daily rates, and ample opportunities for professional growth within a technology-driven environment. Join us to be part of an Agile Scrum team where your contributions will directly impact the reliability and accuracy of our critical Commodity Trading and Risk Management platform.
Contact Details:
INTEC SELECT LIMITED Careers Recruitment Team
