Mistral-Large-4
Mistral AIwe optimize the following per-token objective over the full vocabulary
specific method · filed under training objective
Distillation matches logits across the full vocabulary.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See distillation objective for the methods filed beside it.
3 quotes from 3 sources, one card per model, each opening with its strongest.
we optimize the following per-token objective over the full vocabulary
we adopt full-vocabulary logit distillation in our OPD.
V4 uses full-vocabulary logit distillation instead.
we adopt full-vocabulary logit distillation in our OPD.