At a Glance
- Tasks: Lead the Data Transfer Hub project, designing scalable data transfer systems.
- Company: Wayve, a pioneering tech company in autonomous vehicle data solutions.
- Benefits: Flexible hybrid working, competitive salary, and a supportive team culture.
- Other info: Join a dynamic startup environment with excellent growth opportunities.
- Why this job: Make a real impact on AI model training with cutting-edge technology.
- Qualifications: Experience in large-scale data pipelines and proficiency in Python and Terraform.
The predicted salary is between 80000 - 100000 £ per year.
We are looking for a Staff Data Platform Engineer to own and lead Wayve’s Data Transfer Hub project. This mission‑critical infrastructure will scale to transfer petabytes of sensor data per day from partner‑operated vehicles around the world. This is a hands‑on technical leadership role driving a new project at Wayve. You’ll design and build a globally distributed hub‑and‑spoke ingestion system, working directly with data partners like Uber and Nissan. Your infrastructure is what makes Wayve’s AI model training possible at scale.
What You'll Do
- Set technical direction for the Data Transfer Hub, making trade‑offs across reliability, throughput, cost, partner constraints, observability and operational support.
- Lead the technical design and delivery of the Data Transfer Hub project, ingesting large volumes of video, LiDAR and sensor data from global partners at up to PB/day scale.
- Design and build parallelised, distributed data transfer pipelines using Flyte for workflow orchestration, Kafka/event‑driven patterns for lifecycle tracing, and Azure for storage and transfer infrastructure.
- Build and operate a globally distributed hub‑and‑spoke data transfer model to retrieve and share sensor data at scale with partners.
- Write infrastructure‑as‑code in Terraform; build pipeline logic primarily in Python.
- Drive cloud‑to‑cloud and cross‑cloud networking solutions (Azure primary; cross‑cloud experience beneficial).
- Work in a fast‑changing environment; requirements will evolve; high comfort with ambiguity required.
What We’re Looking For
- Proven experience building and operating large‑scale data transfer pipelines at multi‑TB or PB scale.
- Experience orchestrating parallelised transfer jobs: Flyte preferred; other workflow orchestration tools (e.g. Airflow, Prefect) will be considered.
- Experience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting.
- Strong cloud platform skills (Azure preferred); experience with multiple cloud providers (AWS/GCP) is a strong advantage.
- Proficiency in Python and Terraform.
- Cloud‑to‑cloud and networking experience (e.g. blob/object transfer and storage at scale, cross‑cloud data movement).
- A product mindset: you think about the customer and build solutions that fix real problems, not just implement requirements.
- Comfort working in a fast‑changing environment with evolving requirements: this is a startup within a scale‑up.
- High degree of autonomy and ownership: you take responsibility for outcomes, not just tasks.
Nice to Have
- Experience with Kafka for event‑driven transfer observability.
- Multi‑cloud experience across Azure, AWS and/or GCP.
- Experience working directly with external data partners.
- Background in autonomous vehicles, robotics or similar data‑intensive domains.
Employment Details
Full‑time role based in our office in London. We operate a hybrid working policy that combines time together in our offices and workshops with time spent working from home. Core working hours are flexible to accommodate you and your team.
EEO Statement
At Wayve we’re committed to creating a diverse, fair and respectful culture that is inclusive of everyone based on their unique skills and perspectives, and regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, veteran status, pregnancy or related condition (including breastfeeding) or any other basis as protected by applicable law.
Disclaimer
We will not ask about marriage or pregnancy, care responsibilities or disabilities in any of our job adverts or interviews. However, we do look to capture information about care responsibilities, and disabilities among other diversity information as part of an optional DEI Monitoring form to help us identify areas of improvement in our hiring process and ensure that the process is inclusive and non‑discriminatory.
Staff Data Platform Engineer employer: Wayve
Wayve is an exceptional employer that fosters a dynamic and inclusive work culture, where innovation thrives and employees are empowered to take ownership of their projects. With a hybrid working policy based in London, we offer flexible core hours and a collaborative environment that encourages professional growth and development, making it an ideal place for those looking to make a meaningful impact in the field of data engineering.
StudySmarter Expert Advice🤫
We think this is how you could land Staff Data Platform Engineer
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, especially those at Wayve or similar companies. A friendly chat can open doors and give you insights that a job description just can't.
✨Tip Number 2
Show off your skills! If you've built any cool data transfer pipelines or worked on relevant projects, make sure to highlight them in conversations. Real-world examples can set you apart from the crowd.
✨Tip Number 3
Prepare for the unexpected! Since this role involves working in a fast-changing environment, be ready to discuss how you've adapted to changes in past projects. Flexibility is key!
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets seen. Plus, it shows you're genuinely interested in being part of the Wayve team.
We think you need these skills to ace Staff Data Platform Engineer
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Staff Data Platform Engineer role. Highlight your experience with large-scale data transfer pipelines and any relevant projects you've led. We want to see how your skills align with our mission at Wayve!
Showcase Your Technical Skills:Don’t hold back on showcasing your technical skills! Mention your proficiency in Python, Terraform, and any cloud platforms you’ve worked with. We’re looking for someone who can hit the ground running, so let us know what you bring to the table.
Be Clear and Concise:When writing your application, be clear and concise. We appreciate straightforward communication, especially when it comes to complex topics like data systems. Keep it simple, and make sure we can easily see your qualifications.
Apply Through Our Website:We encourage you to apply through our website! It’s the best way to ensure your application gets to us directly. Plus, you’ll find all the details about the role and our company culture there, which can help you tailor your application even more.
How to prepare for a job interview at Wayve
✨Know Your Tech Inside Out
Make sure you’re well-versed in the technologies mentioned in the job description, like Flyte, Kafka, and Azure. Brush up on your Python and Terraform skills too, as you'll likely be asked to demonstrate your understanding of these tools during the interview.
✨Showcase Your Problem-Solving Skills
Prepare to discuss specific examples where you've built or operated large-scale data transfer pipelines. Highlight how you tackled challenges related to reliability, throughput, and data integrity. This will show that you have a product mindset and can think critically about real-world problems.
✨Embrace the Ambiguity
Since this role involves working in a fast-changing environment, be ready to talk about times when you've successfully navigated ambiguity. Share how you adapt to evolving requirements and maintain focus on delivering results, which is crucial for a startup within a scale-up.
✨Engage with the Company’s Vision
Research Wayve and its mission to understand their approach to AI and data transfer. Be prepared to discuss how your experience aligns with their goals and how you can contribute to the Data Transfer Hub project. Showing genuine interest in the company will set you apart from other candidates.
