Staff Data Platform Engineer in London

Staff Data Platform Engineer in London

London Full-Time 80000 - 100000 £ / year (est.) Home office (partial)
Wayve

At a Glance

  • Tasks: Lead the Data Transfer Hub project, designing scalable data transfer systems for autonomous vehicles.
  • Company: Wayve, a pioneering company in Embodied AI technology for automated driving.
  • Benefits: Hybrid working policy, flexible hours, and a culture of innovation and collaboration.
  • Other info: Join a diverse team that values your unique skills and perspectives.
  • Why this job: Make a real impact on the future of self-driving cars with cutting-edge technology.
  • Qualifications: Experience in large-scale data pipelines, cloud platforms, and proficiency in Python and Terraform.

The predicted salary is between 80000 - 100000 £ per year.

Founded in 2017, Wayve is the leading developer of Embodied AI technology. Our advanced AI software and foundation models enable vehicles to perceive, understand, and navigate any complex environment, enhancing the usability and safety of automated driving systems. Our vision is to create autonomy that propels the world forward. Our intelligent, mapless, and hardware-agnostic AI products are designed for automakers, accelerating the transition from assisted to automated driving.

In our fast-paced environment big problems ignite us—we embrace uncertainty, leaning into complex challenges to unlock groundbreaking solutions. We aim high and stay humble in our pursuit of excellence, constantly learning and evolving as we pave the way for a smarter, safer future. At Wayve, your contributions matter. We value diversity, embrace new perspectives, and foster an inclusive work environment; we back each other to deliver impact.

Portal is the cloud platform that connects Wayve to the outside world: handling data exchange with partners, surfacing AI insights, and enabling the commercial deployment of Wayve's autonomy stack to OEM partners globally. The team operates as a startup within a scale-up: with its own infrastructure, codebase, and direct relationships with commercial partners including Uber, Nissan and other OEMs. We move fast, own our decisions, and build systems that matter.

We're looking for a Staff Data Platform Engineer to own and lead Wayve's Data Transfer Hub project. This is a mission-critical piece of infrastructure that will scale to transfer petabytes of sensor data per day from partner-operated vehicles around the world. This is a hands-on technical leadership role driving a new project at Wayve. You'll design and build a globally distributed hub-and-spoke ingestion system, working directly with data partners like Uber and Nissan. Your infrastructure is what makes Wayve's AI model training possible at scale.

What You'll Do

  • Set technical direction for the Data Transfer Hub, making trade-offs across reliability, throughput, cost, partner constraints, observability and operational support.
  • Lead the technical design and delivery of the Data Transfer Hub project, ingesting large volumes of video, LiDAR and sensor data from global partners at up to PB/day scale.
  • Design and build parallelised, distributed data transfer pipelines using Flyte for workflow orchestration, Kafka/event-driven patterns for lifecycle tracing, and Azure for storage and transfer infrastructure.
  • Build and operate a globally distributed hub-and-spoke data transfer model to retrieve and share sensor data at scale with partners.
  • Write infrastructure-as-code in Terraform; build pipeline logic primarily in Python.
  • Drive cloud-to-cloud and cross-cloud networking solutions (Azure primary; cross-cloud experience beneficial).
  • Work in a fast-changing environment: requirements will evolve; high comfort with ambiguity required.

What We're Looking For

  • Proven experience building and operating large-scale data transfer pipelines at multi-TB or PB scale.
  • Experience orchestrating parallelised transfer jobs: Flyte preferred; other workflow orchestration tools (e.g. Airflow, Prefect) will be considered.
  • Experience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting.
  • Strong cloud platform skills (Azure preferred); experience working with multiple cloud providers (AWS/GCP) is a strong advantage.
  • Proficiency in Python and Terraform.
  • Cloud-to-cloud and networking experience (e.g. blob/object transfer and storage at scale, cross-cloud data movement).
  • A product mindset: you think about the customer and build solutions that fix real problems, not just implement requirements.
  • Comfort working in a fast-changing environment with evolving requirements: this is a startup within a scale-up.
  • High degree of autonomy and ownership: you take responsibility for outcomes, not just tasks.

Nice to Have

  • Experience with Kafka for event-driven transfer observability.
  • Multi-cloud experience across Azure, AWS and/or GCP.
  • Experience working directly with external data partners.
  • Background in autonomous vehicles, robotics or similar data-intensive domains.

This is a full-time role based in our office in London. At Wayve we want the best of all worlds so we operate a hybrid working policy that combines time together in our offices and workshops to fuel innovation, culture, relationships and learning, and time spent working from home. We operate core working hours so you can determine the schedule that works best for you and your team.

Wayve is committed to creating an inclusive interview experience. If you require any accommodations or adjustments to participate fully in our interview process, please let us know. We understand that everyone has a unique set of skills and experiences and that not everyone will meet all of the requirements listed above. If you’re passionate about self-driving cars and think you have what it takes to make a positive impact on the world, we encourage you to apply.

At Wayve we're committed to creating a diverse, fair and respectful culture that is inclusive of everyone based on their unique skills and perspectives, and regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, veteran status, pregnancy or related condition (including breastfeeding) or any other basis as protected by applicable law.

Staff Data Platform Engineer in London employer: Wayve

Wayve is an exceptional employer that champions innovation and inclusivity, making it an ideal place for a Staff Data Platform Engineer to thrive. With a hybrid working policy that promotes flexibility and a culture that values diverse perspectives, employees are empowered to take ownership of their projects while collaborating with industry leaders like Uber and Nissan. The opportunity for professional growth in a fast-paced, supportive environment ensures that your contributions will not only impact the company but also shape the future of autonomous driving technology.

Wayve

Contact Details:

Wayve Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Staff Data Platform Engineer in London

Tip Number 1

Network like a pro! Reach out to folks in the industry, especially those at Wayve. A friendly chat can open doors and give you insights that a job description just can't.

Tip Number 2

Prepare for the interview by diving deep into Wayve's projects and values. Show us how your skills align with our mission to revolutionise automated driving—it's all about making that connection!

Tip Number 3

Practice your technical skills! Be ready to discuss your experience with data transfer pipelines and cloud platforms. We want to see how you tackle real-world problems, so bring your A-game!

Tip Number 4

Apply through our website! It’s the best way to ensure your application gets noticed. Plus, it shows you're genuinely interested in being part of the Wayve team.

We think you need these skills to ace Staff Data Platform Engineer in London

Data Transfer Pipelines
Flyte
Python
Terraform
Azure
Kafka
Cloud Networking

Some tips for your application 🫡

Show Your Passion:When writing your application, let your enthusiasm for AI and data engineering shine through! We want to see how your interests align with our mission at Wayve, so don’t hold back on sharing what excites you about the role.

Tailor Your CV:Make sure your CV is tailored to the Staff Data Platform Engineer position. Highlight relevant experience with data transfer pipelines and cloud platforms, and don’t forget to mention any hands-on projects that showcase your skills!

Be Clear and Concise:Keep your application clear and to the point. Use bullet points where possible to make it easy for us to read through your experience and skills. We appreciate straightforward communication, especially in a fast-paced environment like ours!

Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen to join the Wayve team!

How to prepare for a job interview at Wayve

Know Your Tech Inside Out

Make sure you’re well-versed in the technologies mentioned in the job description, especially around data transfer pipelines and cloud platforms like Azure. Brush up on your Python and Terraform skills, as these will likely come up during technical discussions.

Showcase Your Problem-Solving Skills

Prepare to discuss specific challenges you've faced in previous roles, particularly those involving large-scale data systems. Be ready to explain how you approached these problems and what solutions you implemented, as this aligns with Wayve's focus on tackling complex challenges.

Understand the Company’s Vision

Familiarise yourself with Wayve’s mission and values. Being able to articulate how your experience and goals align with their vision for autonomous driving will demonstrate your genuine interest in the role and the company.

Ask Insightful Questions

Prepare thoughtful questions that show your understanding of the role and the industry. Inquire about the team dynamics, the challenges they face with data transfer at scale, or how they measure success in their projects. This not only shows your enthusiasm but also helps you gauge if the company is the right fit for you.