single mention · optimization
Maximal Update Parametrization
Uses Maximal Update Parametrization for hyperparameter transfer across model width.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See optimization for the methods filed beside it.
Filed under optimization