Open Models Almanac
Methods

single mention · not yet filed

WSD optimal learning rate scaling law

The sources on this page name it without explaining how it works.

Also called WSD optimal-LR scaling law.