Staff Data Platform Engineer

Join Wayve, a cutting-edge startup in the autonomous vehicle industry. As a Staff Data Platform Engineer, you will lead the Data Transfer Hub project, a critical piece of infrastructure that will scale to transfer petabytes of sensor data per day from partner-operated vehicles around the world. You will design and build a globally distributed hub-and-spoke ingestion system, working directly with data partners like Uber and Nissan. This is a hands-on technical leadership role that requires a high degree of autonomy and ownership.

• Lead the technical design and delivery of the Data Transfer Hub project, ensuring the ingestion of large volumes of data from global partners.
• Set the technical direction for the Data Transfer Hub, making trade-offs across reliability, throughput, cost, partner constraints, observability, and operational support.
• Design and build parallelized, distributed data transfer pipelines using Flyte for workflow orchestration, Kafka/event-driven patterns for lifecycle tracing, and Azure for storage and transfer infrastructure.
• A product mindset: you think about the customer and build solutions that fix real problems, not just implement requirements
• High degree of autonomy and ownership: you take responsibility for outcomes, not just tasks
• Proven experience building and operating large-scale data transfer pipelines at multi-TB or PB scale
• Strong cloud platform skills (Azure preferred); experience working with multiple cloud providers (AWS/GCP) is a strong advantage
• Proficiency in Python and Terraform
• Experience orchestrating parallelised transfer jobs: Flyte preferred; other workflow orchestration tools (e.g. Airflow, Prefect) will be considered
• Experience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting
• Cloud-to-cloud and networking experience (e.g. blob/object transfer and storage at scale, cross-cloud data movement)
• Comfort working in a fast-changing environment with evolving requirements: this is a startup within a scale-up
• Experience with Kafka for event-driven transfer observability
• Multi-cloud experience across Azure, AWS and/or GCP
• Experience working directly with external data partners
• Background in autonomous vehicles, robotics or similar data-intensive domains
• We understand that everyone has a unique set of skills and experiences and that not everyone will meet all of the requirements listed above. If you’re passionate about self-driving cars and think you have what it takes to make a positive impact on the world, we encourage you to apply