At a Glance
- Tasks: Lead the design and delivery of scalable data platforms using Python, AWS, and Kafka.
- Company: Join a major financial services organisation transforming its data ecosystem.
- Benefits: Competitive daily rate, hybrid working, and potential for contract extension.
- Other info: Collaborate with diverse teams and mentor fellow engineers in a dynamic environment.
- Why this job: Shape the future of data in finance while working with cutting-edge technologies.
- Qualifications: Deep experience in streaming platforms, AWS, and data engineering leadership.
We are seeking a Principal Data Engineer to join a large financial services organisation undergoing a major data platform transformation. This role sits at the intersection of architecture, engineering leadership, and hands‑on development, shaping a modern, cloud‑native data ecosystem. You will lead the design and delivery of highly scalable, real‑time and batch data platforms built on Python, AWS and Kafka, working closely with architecture, trading, risk, and analytics teams.
Key Responsibilities
- Technical Leadership
- Own the design and evolution of the enterprise data platform
- Define best practices, engineering standards, and data governance patterns
- Provide technical leadership to multiple data engineering squads
- Drive adoption of event‑driven and streaming architectures
- Design and build high‑throughput, low‑latency data pipelines
- Implement robust real‑time streaming solutions using Kafka
- Develop and maintain scalable Python‑based data services
- Architect secure and resilient AWS cloud data infrastructure
- Ensure solutions meet regulatory, security and audit requirements
- Stakeholder Engagement
- Partner with senior stakeholders across Risk, Trading, Compliance and Data Science
- Translate complex business requirements into scalable technical solutions
- Mentor senior and mid‑level engineers across the programme
Required Skills & Experience
- Core Technical
- Deep experience building streaming platforms using Apache Kafka
- Strong hands‑on experience with AWS, including: S3, Lambda, ECS/EKS IAM, networking and security best practices
- Experience building real‑time and batch ETL/ELT pipelines
- Strong experience with data modelling and distributed systems
- Proven experience operating at Principal / Lead Data Engineer level
- Strong understanding of event‑driven and microservices architectures
- Experience working in regulated financial services environments
- Experience with data mesh / data lakehouse architectures
- Knowledge of CI/CD and DevOps tooling (Terraform, Docker, Kubernetes)
- Experience with data governance and lineage tooling
- Exposure to market, risk, or trading data environments
Working Pattern
- Hybrid: 3 days onsite in Canary Wharf, 2 days remote
- £775 per day inside IR35
- 12-month contract with strong likelihood of extension
Principal Data Engineer employer: Oliver Bernard
Join a leading financial services organisation in Canary Wharf, where innovation meets opportunity. As a Principal Data Engineer, you will thrive in a dynamic work culture that values collaboration and technical excellence, with ample opportunities for professional growth and mentorship. Enjoy the benefits of a hybrid working model, competitive compensation, and the chance to shape the future of data engineering in a transformative environment.
StudySmarter Expert Advice🤫
We think this is how you could land Principal Data Engineer
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who work in financial services or data engineering. A friendly chat can lead to insider info about job openings that aren't even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Python, AWS, and Kafka. This will give potential employers a taste of what you can do and set you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Be ready to discuss your experience with event-driven architectures and how you've tackled challenges in previous roles. Confidence is key!
✨Tip Number 4
Don't forget to apply through our website! We have loads of opportunities that might be perfect for you. Plus, it shows you're serious about joining our team and makes it easier for us to find your application.
We think you need these skills to ace Principal Data Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV speaks directly to the role of Principal Data Engineer. Highlight your experience with AWS, Kafka, and any relevant financial services work. We want to see how your skills align with our needs!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for this role. Mention specific projects where you've demonstrated technical leadership and your ability to translate complex requirements into scalable solutions.
Showcase Your Technical Skills:In your application, don't just list your skills—show us how you've used them! Provide examples of high-throughput data pipelines you've built or any real-time streaming solutions you've implemented. We love seeing practical applications of your expertise.
Apply Through Our Website:We encourage you to apply through our website for a smoother process. It helps us keep track of your application and ensures you don’t miss out on any important updates. Plus, we’re excited to see what you bring to the table!
How to prepare for a job interview at Oliver Bernard
✨Know Your Tech Inside Out
Make sure you’re well-versed in the technologies mentioned in the job description, especially Python, AWS, and Kafka. Brush up on your experience with streaming platforms and be ready to discuss specific projects where you've implemented these technologies.
✨Showcase Your Leadership Skills
As a Principal Data Engineer, you'll need to demonstrate your ability to lead teams and mentor others. Prepare examples of how you've guided engineering squads, defined best practices, or influenced architectural decisions in previous roles.
✨Understand the Business Context
Familiarise yourself with the financial services sector and the specific challenges it faces regarding data governance and compliance. Be prepared to translate complex business requirements into technical solutions, showing that you can bridge the gap between tech and business.
✨Prepare for Scenario-Based Questions
Expect questions that assess your problem-solving skills in real-time scenarios. Think about how you would design a scalable data pipeline or handle a data governance issue. Practising these scenarios will help you articulate your thought process clearly during the interview.
