Senior Member of Technical Staff (Synthetic Data)

Join Cohere as a Senior Member of Technical Staff specializing in synthetic data. In this role, you will manage the synthetic data pipeline, conduct data analysis and generation, and evaluate data quality. You will work with diverse web and code data, transforming them using generative models to improve token efficiency and model quality. Your work will directly contribute to advancements in natural language processing and the efficiency of Cohere's language models. Enjoy a range of benefits, including six weeks of paid vacation, equity options, and a remote work culture.

• End-to-end management of synthetic data, including maintaining and optimizing the synthetic data pipeline, data analysis and generation, and conducting data ablations.
• Designing and building scalable inference pipelines that run on large GPU clusters, and conducting data ablations to assess data quality.
• Researching and implementing innovative synthetic data curation methods, leveraging Cohere’s infrastructure to drive advancements in natural language processing.
• Strong software engineering skills, with proficiency in Python and experience building data pipelines
• A passion for bridging research and engineering to solve complex data-related challenges in AI model training
• Experience working with LLMs through work projects, open-source contributions or personal experimentation
• Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools
• Familiarity with LLM inference frameworks such as vLLM and TensorRT
• If you are passionate about transforming data into the foundation of AI systems, this role offers a unique opportunity to make a meaningful impact
• Experience working with large-scale datasets, including web data, code data, and multilingual corpora
• Bonus: paper at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)
• If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!