Principal System Software Engineer (AI Inference Execution)

Join our team as a Principal System Software Engineer, where you will play a key role in productizing the software stack for our AI compute engine. You will be responsible for the development, enhancement, and maintenance of next-generation AI deployment software. This position requires a strong background in distributed, high-performance software design and implementation, as well as experience with various aspects of hardware-software co-design. You will work closely with other software and hardware experts in the company.

• Participer à l'équipe qui aide à productiser la pile logicielle pour notre moteur de calcul AI.
• Responsable du développement, de l'amélioration et de la maintenance du logiciel de déploiement AI de prochaine génération.
• Travailler avec une équipe d'experts en logiciels système pour construire l'infrastructure de déploiement.
• Self-motivated team player with a strong sense of ownership and leadership
• Experience with distributed, high-performance software design and implementation
• Proficient in C/C++/Python development in Linux environment and using standard development tools
• Strong grasp of system software, data structures, computer architecture, and machine learning fundamentals
• MS or PhD in Computer Science, Electrical Engineering, or related fields
• Experience with inference servers/model serving frameworks (such as TensorRT-LLM, vLLM, SGLang, etc.)
• Experience with deep learning frameworks (such as PyTorch and TensorFlow)
• Experience with deep learning runtimes (such as ONNX Runtime, TensorRT, etc.)
• Experience deploying ML workloads (LLMs, VLMs, NLP, etc.) on distributed systems
• Experience with software testing fundamentals
• Experience with distributed systems collectives such as NCCL and OpenMPI
• Prior startup, small team, or incubation experience
• Experience with Kubernetes, Ray, or other MLOps tools and techniques used from definition to deployment
• Work experience at a cloud provider or AI compute/subsystem company
• BS in Computer Science, Engineering, Math, Physics, or related degree with 12+ years of industry software development experience and MS in Computer Science, Engineering, Math, Physics, or related degree preferred with 6+ years