- Build and optimise data pipelines using Java (preferred) or Python.
- Develop real-time streaming and batch data pipelines.
- Work with Kafka, Flink or Spark, with Kafka/Flink preferred.
- Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue.
- Implement data governance, lineage, security and quality controls.
- Support CI/CD using Azure DevOps, GitHub Actions or Jenkins.
- Use Terraform and Infrastructure as Code practices.
- Deploy containerised workloads using Docker, Kubernetes and AWS EKS.
- Collaborate with analytics, AI/ML, product and engineering teams.
Data Engineer - Senior Analyst in Newcastle upon Tyne employer: Opus RS
Opus RS offers a dynamic work environment with opportunities for professional growth, particularly in high-impact roles within the utilities and infrastructure sectors. The company supports flexible working arrangements, allowing employees to balance their professional and personal lives effectively. With a focus on transformation and innovation, Opus RS provides its team members with the chance to lead significant projects that shape the future of technology and security.