single mention · optimization
Hybrid Muon and Adam optimization
Muon is used for large matrix weights while Adam is used for other parameters.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See optimizer for the methods filed beside it.
Also called Hybrid optimization with Muon and Adam.
Filed under optimization › optimizer