Open Models Almanac
Methodsoptimizationtraining precision

specific method · filed under optimization

FP8 mixed-precision training

Training using mixed precision with FP8; the evidence does not specify a more particular precision recipe.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See training precision for the methods filed beside it.

Also called FP8 mixed precision.

sources
4
models
2
lab adopt it
1
strongest
used

Documented in

Evidence

4 quotes from 4 sources, one card per model, each opening with its strongest.

How sources treat it
used 4

MiMo-V2.5

Xiaomiadopted3 sources

we adopt an FP8 mixed-precision framework similar to DeepSeek-V3

usedoptimizationin MiMo-V2-FlashXiaomi
2 more from this model

Trained on a total of ~48T tokens using FP8 mixed precision.

usedoptimizationin MiMo-V2.5Xiaomi

Trained on a total of ~48T tokens using FP8 mixed precision.

usedtraining objectivein MiMo-V2.5Xiaomi

Further reading

Picked by hand, not extracted: where to read more, not evidence for anything on this page.

↑