Open Models Almanac
Methodsoptimizationoptimizer

implementation detail · filed under optimization

Nesterov momentum

Nesterov momentum is used with Muon, including as the momentum input to Newton–Schulz iteration.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See optimizer for the methods filed beside it.

Also called Nesterov-accelerated momentum, Nesterov trick.

sources
2
models
3
labs adopt it
2
strongest
used

Documented in

Evidence

2 quotes from 2 sources, one card per model, each opening with its strongest.

How sources treat it
used 2
↑