single mention · model architecture
Gated DeltaNet hybrid attention
A hybrid-attention configuration identified by its use of Gated DeltaNet attention alongside other attention types.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See gated delta network for the methods filed beside it.
Also called gated delta networks hybrid attention.
Filed under model architecture › token mixer › linear attention & state space › gated delta network