Software Engineer (GPU Infrastructure, High Performance Computing)

Join Cohere, a leading AI company, as a Software Engineer focused on GPU Infrastructure and High Performance Computing. You will work closely with AI researchers to build and operate superclusters across multiple clouds, optimize infrastructure for AI/ML training, troubleshoot complex issues, and drive innovation in ML infrastructure. Enjoy benefits such as six weeks of paid vacation, equity options, comprehensive insurance coverage, and a remote work culture.

• Construire et gérer des superclusters GPU/TPU optimisés pour l'apprentissage automatique sur plusieurs clouds, en garantissant un haut débit et une faible latence.
• Collaborer avec les fournisseurs de cloud pour affiner l'infrastructure en termes de coût, de fiabilité et de performance, en tirant parti de technologies avancées.
• Identifier et résoudre de manière proactive les goulets d'étranglement de l'infrastructure, la dégradation des performances et les pannes système.
• Low-level systems knowledge: Familiarity with Linux internals, RDMA networking, and performance optimization for ML workloads
• Kubernetes at scale: Proven ability to deploy, manage, and troubleshoot cloud-native Kubernetes clusters for AI workloads
• Research collaboration experience: A track record of working closely with AI researchers or ML engineers to solve infrastructure challenges
• Deep expertise in ML/HPC infrastructure: Experience with GPU/TPU clusters, distributed training frameworks (JAX, PyTorch, TensorFlow), and high-performance computing (HPC) environments
• Strong programming skills: Proficiency in Python (for ML tooling) and Go (for systems engineering), with a preference for open-source contributions over reinventing solutions
• Self-directed problem-solving: The ability to identify bottlenecks, propose solutions, and drive impact in a fast-paced environment
• If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!