implementation detail · not yet filed
Fused gated residual read and final normalization
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
used 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
Fusing the residual read and the final normalization before the LM head into one gated read operation further reduces the gradient norm
usedmodel architecturein Qwen3.8-Flash-NextQwen