Mistral-Large-4
Mistral AIThe model also shares KV state across layers.
1 more from this model
cross-layer KV sharing
specific method · filed under inference & serving
Reuses or shares KV state across model layers to reduce cache footprint.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See KV cache management for the methods filed beside it.
Also called Cross-layer key-value cache reuse, cross-layer KV cache reuse, Cross-layer key-value cache sharing, cross-layer KV sharing, Cross-layer KV-state sharing, shares KV state across layers.
2 quotes from 2 sources, one card per model, each opening with its strongest.
The model also shares KV state across layers.
cross-layer KV sharing