single mention · model architecture
Top-512 block selection
Keeps the best 512 blocks and expands them back to 2048 logical token positions.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See block selection for the methods filed beside it.
Also called QSA keeps the best 512 blocks.
Filed under model architecture › token mixer › sparse attention › block selection