Qwen3.8-Flash-Next
Alibaba (Qwen)The NS iteration is applied to a Nesterov-accelerated momentum
usedoptimizationin Qwen3.8-NextQwen Team
implementation detail · filed under optimization
Nesterov momentum is used with Muon, including as the momentum input to Newton–Schulz iteration.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See optimizer for the methods filed beside it.
Also called Nesterov-accelerated momentum, Nesterov trick.
2 quotes from 2 sources, one card per model, each opening with its strongest.
The NS iteration is applied to a Nesterov-accelerated momentum
we also apply weight decay to Muon parameters, use the Nesterov trick