Member of Technical Staff (Multimodal Understanding)
xAI · Palo Alto, United States
About The Role
Join our multimodal team as a Member of Technical Staff, where you will contribute to advancing understanding and generation across modalities including image, video, audio, and text. You will collaborate cross-functionally to deliver frontier capabilities in multimodal reasoning, world modeling, tool use, agentic behaviors, and interactive human-AI collaboration. Your work will involve designing and optimizing large-scale distributed systems, developing high-throughput pipelines, advancing multimodal capabilities, driving data quality and studies, creating evaluation frameworks, and innovating on algorithms and modeling approaches.
- Contribuer à l'avancement de la compréhension et de la génération multimodales, en travaillant sur l'ensemble du processus, de l'acquisition des données à l'expérience produit.
- Collaborer de manière transversale avec différentes équipes pour livrer des capacités de pointe en matière de raisonnement multimodal, de modélisation du monde et de collaboration interactive homme-AI.
- Concevoir, construire et optimiser des systèmes distribués à grande échelle pour le pré-entraînement multimodal, le post-entraînement, l'inférence et le traitement des données.
- Deep experience designing and running data pipelines at scale: curation, filtering, generation, quality studies, especially for noisy/real-world multimodal data
- Hands-on experience with multimodal pre-training, post-training, or fine-tuning (vision, audio, video, or cross-modal)
- Strong fundamentals in evaluation design, benchmarks, reward modeling, or RL techniques (particularly for interactive/agentic behaviors)
- Willingness to own end-to-end initiatives and do whatever it takes to deliver breakthrough user experiences
- Proven track record building or optimizing large-scale distributed ML systems (training/inference optimization, GPU utilization, multi-GPU/TPU setups, hardware co-design)
- Expert-level proficiency in Python (core language), with strong experience in at least one of: JAX / PyTorch / XLA
- Proactive self-starter who thrives in high-intensity environments and is passionate about pushing multimodal AI frontiers
- Experience leading major improvements in model capabilities through better data, modeling, algorithms, or scaling
- Familiarity with state-of-the-art in multimodal LLMs, scaling laws, tokenizers, compression techniques, reasoning, or agentic systems
- Background building full-stack tooling: performant interfaces, real-time research demos/apps, or end-to-end product ownership
- Proficiency in Rust and/or C++ for performance-critical components
- Passion for end-to-end user experience in interactive, real-time multimodal AI systems
- Hands-on work with large-scale orchestration tools such as Spark, Ray, or Kubernetes
This is an external listing. JobSpring does not represent or verify the employer. Report this listing
JobSpring