Model techniques map
Techniquesinference & servingcontext management

specific method · filed under inference & serving

Memory compression

A strategy that prompts the model to summarize history, archives the full history to retrievable memory, and replaces active context with the summary.

Also called memory compression (context consolidation).

source
1
model
1
lab adopt it
1
strongest
used

How sources treat it

One count per evidence span, weakest treatment to strongest.

used 1

Documented in

Evidence

1 span quoted from the sources, strongest treatment first.

we combat the 'Lost in the Middle' phenomenon by enforcing aggressive memory compression. When context utilization exceeds a threshold ... the system prompts the model to summarize, archives the full history to a retrievable memory file, and replaces active context with the summary.

usedinference servingin MiMo-V2-FlashXiaomi

Filed alongside

Other methods under inference & serving :: context management.