Qwen3.8-Flash-Next
Alibaba (Qwen)The Muon and AdamW optimizers are applied to specific weight categories to maximize efficiency.
4 more from this model
the input and n-gram embeddings, output head, MoE router and the low-rank projections of GR stay on AdamW
The Muon and AdamW optimizers are applied to specific weight categories
the division of labour between Muon and AdamW
Muon and AdamW applied to specific weight categories