specific method · filed under model architecture
Lightning Indexer
The Lightning Indexer computes the index score between the query token and a preceding token, determining which tokens to be selected by the query token.1 This mechanism is used to retrieve only the key-value entries corresponding to the top-k index scores.2
Trade-off The indexer is computationally efficient because it has a small number of heads and can be implemented in FP8.3
How this definition was written
Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.
The lightning indexer computes the index score between the query token and a preceding token , determining which tokens to be selected by the query token
— DeepSeek-V3.2: Pushing the Frontier of Open Large Language ModelsGiven the index scores for each query token , our fine-grained token selection mechanism retrieves only the key-value entries corresponding to the top-k index scores
— DeepSeek-V3.2: Pushing the Frontier of Open Large Language ModelsGiven that the lightning indexer has a small number of heads and can be implemented in FP8, its computational efficiency is remarkable
— DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models