Senior Software Engineer (Inference)

Join our Inference team as a Senior Software Engineer, where you'll be responsible for building and maintaining critical systems that serve our AI model, Claude, to millions of users worldwide. You'll tackle complex distributed systems challenges, design intelligent routing algorithms, and contribute to new inference features. Enjoy comprehensive benefits, a competitive salary, and the opportunity to make a significant impact in the field of machine learning.

• Conception et mise en œuvre d'algorithmes de routage intelligents pour optimiser la distribution des requêtes.
• Autoscaling de notre flotte de calcul pour s'adapter dynamiquement à l'offre et à la demande.
• Construction de pipelines de déploiement de production pour la mise en service de nouveaux modèles.
• Want to learn more about machine learning systems and infrastructure
• Pick up slack, even if it goes outside your job description
• Care about the societal impacts of your work
• Have significant software engineering experience, particularly with distributed systems
• Thrive in environments where technical excellence directly drives both business results and research breakthroughs
• Are results-oriented, with a bias towards flexibility and impact
• High-performance, large-scale distributed systems
• Implementing and deploying machine learning systems at scale
• Load balancing, request routing, or traffic management systems
• LLM inference optimization, batching, and caching strategies
• Kubernetes and cloud infrastructure (AWS, GCP)
• Python or Rust
• Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience
• We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work