single mention · optimization
MXFP8 Mamba output projections
Keeping Mamba output projection layers in MXFP8 to prevent information loss.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See training precision for the methods filed beside it.
Also called keep these layers in MXFP8.
Filed under optimization › training precision