Open Models Almanac
Methodsinference & servingcontext management

methods · inference & serving

context management

24 methods filed at this node or below it, from the sources of 17 models.

In this branch 24

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 24

Preserved thinking history core · 9 sources · 9 quotes
Excluding prior thinking from multi-turn history default · 6 sources · 6 quotes
Discard-all context management used · 6 sources · 7 quotes
Context compaction used · 3 sources · 3 quotes
Context folding used · 2 sources · 2 quotes
Context management method used · 2 sources · 2 quotes
Discard-75% evaluated · 2 sources · 2 quotes
Trajectory summarization and rollout re-initiation evaluated · 2 sources · 2 quotes
15 single mentions
Context reuse core · 1 source · 1 quote
Remove prior-turn reasoning unless preserved default · 1 source · 1 quote
Automatic prompt truncation used · 1 source · 1 quote
Cosine similarity used · 1 source · 1 quote
Discarding tool-call history used · 1 source · 1 quote
Four-step observation history used · 1 source · 1 quote
Hierarchical context management used · 1 source · 1 quote
Keep-recent-k used · 1 source · 1 quote
Memory compression used · 1 source · 1 quote
Inference-time vision-token budget scaling optional · 1 source · 1 quote
Modality-specific deployment optional · 1 source · 1 quote
Summary-based context compression evaluated · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

Modelmethods
GLM-5.3 usedContext management method used—
NVIDIA-Nemotron-3-Ultra-550B-A55B usedDiscard-all context management usedSummary-based context compression evaluated—
DeepSeek-V3.2 usedContext management method usedTest-time context management for extending token budgets usedTool-use reasoning-context persistence and selective deletion usedDiscard-75% evaluatedDiscard-all context management evaluatedTrajectory summarization and rollout re-initiation evaluated—
GLM-5.2 usedDiscard-all context management usedHierarchical context management usedKeep-recent-k used—
Gemma 4 31B defaultExcluding prior thinking from multi-turn history defaultModality-specific deployment optional—
Kimi K3 corePreserved thinking history coreContext compaction used—
LFM3-1.7B defaultRemove prior-turn reasoning unless preserved defaultAutomatic prompt truncation usedInference-time vision-token budget scaling optional—
Laguna-S-2.1 usedPreserved thinking history used—
MiMo-V2.5 usedDiscarding tool-call history usedMemory compression used—
MolmoAct 2 coreAdaptive depth-token prediction with cached unchanged cells coreCosine similarity used—
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B coreContext reuse core—
Qwen3.5-397B-A17B defaultExcluding prior thinking from multi-turn history defaultContext folding usedDiscard-all context management evaluated—
Qwen3.6-35B-A3B usedPreserved thinking history used—
Qwen3.8-Flash-Next defaultPreserved thinking history default—
VLA Foundry (Foundry-VLA-1.7B) usedTemporal action chunking with past-context conditioning used—
Xiaomi-Robotics-1 usedFour-step observation history used—
gpt-oss-120b usedExcluding prior thinking from multi-turn history used—
↑