Open Models Almanac
Methodsoptimization

single mention · optimization

Maximal Update Parametrization

Uses Maximal Update Parametrization for hyperparameter transfer across model width.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See optimization for the methods filed beside it.

Filed under optimization