general family · not yet filed
Gated DeltaNet and Qwen Sparse Attention hybrid architecture
Also called GDN + QSA hybrid architecture.
- sources
- 2
- model
- 1
- lab adopt it
- 1
- strongest
- core
How sources treat it
One count per evidence span, weakest treatment to strongest.
core 2
Documented in
Evidence
2 spans quoted from the sources, strongest treatment first.
out of every 4 layers, 3 GDN layers compress history into a fixed-size state, while the remaining layer performs precise retrieval over the full context.
coreunclearin Qwen3.8-Flash-NextQwen
A GDN + QSA hybrid architecture. Gated DeltaNet (GDN) compresses the history efficiently; Qwen Sparse Attention (QSA) uses a compressed lightweight indexer to select the important context at micro-block granularity
coremodel architecturein Qwen3.8-Flash-NextQwen