Software Engineer (Bulk/Interactive Inference)

Join Waymo, a leader in autonomous driving technology, as a Software Engineer focused on building and maintaining critical data and ML pipelines. In this hybrid role, you will work closely with various teams to develop and improve Waymo's inference platform, ensuring scalability, high throughput, and low latency. You will also deploy and integrate model inference solutions across various use cases. Enjoy a comprehensive benefits package, including medical, dental, and vision insurance, competitive compensation, and a hybrid work model.

• Develop and maintain Waymo's inference platform to ensure scalability, high throughput, and low latency.
• Collaborate with cross-functional teams to host and improve the efficiency of internal and external ML models, including large language models (LLMs).
• Deploy and integrate model inference solutions across various use cases, such as distillation, evaluation, dataset generation, active learning, and auto-labeling.
• Experience with handling datasets in the order of exabytes
• Passionate about building internal infra and tools
• Experience in programming C++
• Experience with building highly scalable distributed system
• Experience with building model hosting and inference solutions
• 2+ years of professional experience in the field of software engineering