Open Models Almanac
Methodsoptimizationoptimizer

single mention · optimization

Hybrid Muon and Adam optimization

Muon is used for large matrix weights while Adam is used for other parameters.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See optimizer for the methods filed beside it.

Also called Hybrid optimization with Muon and Adam.

Filed under optimization › optimizer