Senior Software Engineer (Together Cloud Platform)

Join Together AI, a company focused on building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle. As a Senior Backend Engineer, you will play a key role in building a highly available, global, and fast cloud infrastructure that virtualizes cutting-edge ML hardware. You will work on a distributed GPU scheduling system, build a global management plane, design and build new customer-facing cloud platform services, and analyze and improve the robustness and scalability of existing systems. You will also partner with product teams, write clear and maintainable software, conduct design and code reviews, and participate in an on-call rotation.

• Contribuer à la construction de la prochaine génération de la plateforme cloud AI, en jouant un rôle clé dans le développement d'une infrastructure cloud hautement disponible et mondiale.
• Travailler sur un système de planification GPU distribué pour le produit de clusters à la demande, Instant Clusters, et construire un plan de gestion global pour gérer le calcul, le réseau et le stockage des centres de données.
• Identifier, concevoir et développer des services backend fondamentaux qui alimentent la plateforme de commerce de Together, en analysant et en améliorant la robustesse et l'évolutivité des systèmes distribués existants.
• Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
• Experience with Kubernetes and containers preferred
• Proficiency in version control practices and integrating IaC with CI/CD pipelines
• Expert-level programmer in one or more of programming language (Golang preferred)
• Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers (AWS, Azure, GCP)
• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
• Experience building and operating data infrastructure (Kinesis, Airflow, Kafka, etc) a plus
• Experience developing against and managing a relational database, such as PostgreSQL
• Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
• Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
• 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices