AI Engineer, Product

Join Mistral, a leading provider of full-stack AI solutions. As an AI Engineer, you will be embedded in a product team and responsible for improving AI-powered features through rigorous evaluation, prompt and orchestration design, and rapid experimentation. You will define and track metrics, run A/B tests, and operate model releases. The ideal candidate has 3-4 years of experience, strong TypeScript or Python skills, and production LLM experience.

• Design and run evaluations for product areas, including reference tests, heuristics, and model-graded checks.
• Define and track metrics that matter, such as task success, helpfulness, hallucination proxies, safety flags, latency, and cost.
• Own prompt and orchestration design, including writing, testing, and iterating on prompts and system prompts.