single mention · inference & serving
Cached depth-token replay for unchanged cells
Reuses prior predicted depth tokens for unchanged cells as known model inputs.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See KV cache management for the methods filed beside it.
Filed under inference & serving › KV cache management