Model techniques map
Techniquesmodel architecturetoken mixersparse attentionblock selection

ambiguous · filed under model architecture

Dynamic sparse selection

A sparse-attention selection mechanism described only as dynamic; the evidence does not specify how it selects blocks.

source
1
model
1
lab adopt it
1
strongest
core

How sources treat it

One count per evidence span, weakest treatment to strongest.

core 1

Documented in

Evidence

1 span quoted from the sources, strongest treatment first.

dynamic sparse selection

coremodel architecturein MiniMax Sparse AttentionMiniMax

Filed alongside

Other methods under model architecture :: token mixer :: sparse attention :: block selection.