specific method · filed under optimization
Adam
The Adam optimizer is used for parameters identified as embedding weights and norm scales or an N-gram embedding table.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See optimizer for the methods filed beside it.
Also called Adam optimizer.
Documented in
Aleph Alpha
Alibaba (Qwen)
Evidence
2 quotes from 2 sources, one card per model, each opening with its strongest.
How sources treat it
used 2
Qwen3.8-Flash-Next
Alibaba (Qwen)the -gram embedding table runs on Adam with weight decay disabled.
usedoptimizationin Qwen3.8-NextQwen Team