At a Glance
- Tasks: Lead the design and delivery of scalable data platforms using Python, AWS, and Spark.
- Company: Join a major financial services organisation transforming its data platform.
- Benefits: Competitive pay of £800 per day, hybrid work model, and potential contract extension.
- Other info: Mentor engineers and engage with senior stakeholders in a dynamic environment.
- Why this job: Shape a modern data ecosystem and make a real impact in finance.
- Qualifications: Strong experience with Spark, Kafka, AWS, and data engineering best practices.
The predicted salary is between 63000 - 77000 £ per year.
Location
- 3 days onsite in Canary Wharf, London
- Overview
- We are seeking
Senior Data Engineers to join a large financial services organisation undergoing a major data platform transformation. This role sits at the intersection of architecture, engineering leadership, and hands-on development , shaping a modern, cloud-native data ecosystem.
You will lead the design and delivery of highly scalable, real-time and batch data platforms built on
Python, AWS and Spark , working closely with architecture, trading, risk, and analytics teams.
Key Responsibilities
- Own the design and evolution of the enterprise data platform
- Define best practices, engineering standards, and data governance patterns
- Provide technical leadership to multiple data engineering squads
- Drive adoption of event-driven and streaming architectures
- Design and build high-throughput, low-latency data pipelines
- Implement robust real-time streaming solutions using Kafka
- Develop and maintain scalable
- Python-based data services
- Architect secure and resilient
- AWS cloud data infrastructure
- Ensure solutions meet regulatory, security and audit requirements
- Stakeholder Engagement
- Partner with senior stakeholders across Risk, Trading, Compliance and Data Science
- Translate complex business requirements into scalable technical solutions
- Mentor senior and mid-level engineers across the programme
- Required Skills & Experience
- Core Technical
- Strong
- Spark
- Deep experience building streaming platforms using Apache Kafka
- Strong hands-on experience with
AWS , including
- S3, Lambda, ECS/EKS
- IAM, networking and security best practices
- Experience building real-time and batch ETL/ELT pipelines
- Strong experience with data modelling and distributed systems
- Strong understanding of event-driven and microservices architectures
- Experience working in regulated financial services environments
- Experience with data mesh / data lakehouse architectures
- Knowledge of
- CI/CD and Dev Ops tooling
- (Terraform, Docker, Kubernetes)
- Experience with data governance and lineage tooling
- Exposure to market, risk, or trading data environments
- Working Pattern
• Hybrid
- 3 days onsite in Canary Wharf , 2 days remote
- £800 per day inside IR35
- 12-month contract with strong likelihood of extension
- #J-18808-Ljbffr
Senior Data Engineers employer: Oliver Bernard
At Oliver Bernard, we pride ourselves on being an excellent employer that fosters innovation and collaboration in the tech space. Our hybrid work model allows for flexibility while still providing opportunities for meaningful face-to-face interactions in our London office. We are committed to employee growth, offering continuous learning opportunities and a supportive work culture that values creativity and teamwork, making us an ideal place for passionate Full Stack Engineers to thrive.
