Open Models Almanac
Methodsinference & servingdecoding strategy

methods · inference & serving

decoding strategy

52 methods filed at this node or below it, from the sources of 34 models.

In this branch 52

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 52

Multi-Token Prediction core · 19 sources · 19 quotes
Speculative decoding core · 15 sources · 15 quotes
DSpark core · 14 sources · 14 quotes
DFlash core · 6 sources · 7 quotes
Five-layer SWA MTP drafter core · 2 sources · 2 quotes
Three-token speculative draft depth core · 2 sources · 2 quotes
Greedy decoding default · 4 sources · 4 quotes
Standardized sampling configuration default · 3 sources · 3 quotes
EAGLE used · 10 sources · 10 quotes
Multi-layer EAGLE used · 5 sources · 5 quotes
NEXTN speculative decoding used · 4 sources · 4 quotes
Best-of-N selection used · 3 sources · 4 quotes
Action-chunk execution used · 2 sources · 2 quotes
Multi-stage candidate filtering used · 2 sources · 2 quotes
Presence penalty tuning used · 2 sources · 3 quotes
Standalone parallel speculative drafters used · 2 sources · 3 quotes
Speculative sampling optional · 3 sources · 3 quotes
Task-specific sampling-parameter presets optional · 3 sources · 3 quotes
LiLiCorr optional · 2 sources · 2 quotes
32 from one source, or only mentioned as not used
Confidence-scheduled verification core · 1 source · 1 quote
Fused recurrent replay kernel core · 1 source · 1 quote
Recurrent Markov draft head core · 1 source · 1 quote
Recursive shared MTP-head drafting core · 1 source · 2 quotes
Semi-autoregressive draft generation core · 1 source · 1 quote
Three-layer dense MLA speculative drafter core · 1 source · 1 quote
Top-K candidate lattice core · 1 source · 1 quote
Same-checkpoint target and draft weights default · 1 source · 1 quote
Block verification used · 1 source · 1 quote
Clustered top-K projection used · 1 source · 1 quote
Drafter-target KV-cache sharing used · 1 source · 1 quote
Grammar-constrained decoding used · 1 source · 1 quote
LiLiCorr single-pass correlation head used · 1 source · 1 quote
Longest-thinking-trace selection used · 1 source · 1 quote
MTP-1 speculative decoding used · 1 source · 1 quote
MTP-to-EAGLE-3 draft-model fine-tuning used · 1 source · 1 quote
Recurrent conditioning head used · 1 source · 1 quote
Second-most-likely action querying used · 1 source · 1 quote
Throughput-based draft-block sizing used · 1 source · 1 quote
Top-p and top-k sampling used · 1 source · 1 quote
Unique mask tokens used · 1 source · 1 quote
Autoregressive discrete action-token inference optional · 1 source · 1 quote
Chat Prefix Completion optional · 1 source · 1 quote
DSpark draft head optional · 1 source · 1 quote
MTP draft-length configuration optional · 1 source · 1 quote
Probabilistic draft sampling optional · 1 source · 1 quote
Temperature sampling for bimanual tasks optional · 1 source · 1 quote
Concurrency-aware draft-length tuning evaluated · 1 source · 1 quote
Confidence head not used · 1 source · 1 quote
Dynamic action querying not used · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

Modelmethods
GLM-5.3-Flash usedMulti-Token Prediction used—
DeepSeek-V4.1-Flash coreConfidence-scheduled verification coreDSpark coreSemi-autoregressive draft generation core—
Hy4-preview usedMulti-Token Prediction usedNEXTN speculative decoding usedSpeculative decoding used—
Step-5-Preview usedMulti-layer EAGLE usedSpeculative decoding usedEAGLE optionalMulti-Token Prediction optional—
MiniMax-M3.1-Flash usedDSpark usedDSpark draft head optionalTemperature and nucleus sampling configuration optional—
GLM-5.3 usedMulti-Token Prediction used—
DeepSeek-V4-Flash-0731 usedDSpark usedChat Prefix Completion optionalSpeculative decoding mentioned—
Hy3 coreSpeculative decoding coreEAGLE optionalSpeculative sampling optional—
MiMo-V2.6-Flash coreDFlash coreFive-layer SWA MTP drafter coreDistribution-matched speculative-draft fine-tuning usedThroughput-based draft-block sizing usedEAGLE optionalSpeculative decoding optional—
NVIDIA-Nemotron-3-Ultra-550B-A55B coreRecursive shared MTP-head drafting coreSpeculative decoding defaultBest-of-N selection usedEAGLE usedMulti-Token Prediction used—
DeepSeek-V3.2 usedLongest-thinking-trace selection usedMulti-stage candidate filtering usedTop-p and top-k sampling used—
DeepSeek-V4-Flash-Vision-Exp defaultSame-checkpoint target and draft weights defaultChat Prefix Completion optionalDSpark optional—
DeepSeek-V4-Pro-0813 optionalChat Prefix Completion optionalDSpark optional—
Gemma 4 31B coreMulti-Token Prediction coreStandardized sampling configuration defaultClustered top-K projection usedDrafter-target KV-cache sharing used—
Inkling coreMulti-Token Prediction core—
Kimi K3 coreFused recurrent replay kernel coreMTP-to-EAGLE-3 draft-model fine-tuning used—
Kolibri-1 usedGreedy decoding used—
LFM3-1.7B usedGreedy decoding usedTask-specific sampling-parameter presets optional—
Laguna-S-2.1 optionalDFlash optional—
MiMo-V2.5 usedMulti-Token Prediction usedSpeculative decoding usedEAGLE optional—
MiMo-V2.5-Pro usedMulti-Token Prediction usedEAGLE optionalMulti-layer EAGLE optional—
MiMo-V2.6-Pro coreDFlash coreFive-layer SWA MTP drafter coreDistribution-matched speculative-draft fine-tuning usedThroughput-based draft-block sizing used—
Mistral-Large-4 coreDSpark coreRecurrent Markov draft head coreThree-layer dense MLA speculative drafter coreThree-token speculative draft depth coreBlock verification usedRecurrent conditioning head usedTemperature and nucleus sampling configuration usedUnique mask tokens used—
MolmoAct 2 usedAction-chunk execution usedAutoregressive discrete action-token inference optional—
NVIDIA-Nemotron-3.5-Lightning-30B-A3B coreSpeculative decoding coreTop-K candidate lattice coreBest-of-N selection usedLiLiCorr single-pass correlation head usedMulti-Token Prediction usedSemi-autoregressive drafting with sequential Markov correction usedStandalone parallel speculative drafters usedDFlash optionalDSpark optionalProbabilistic draft sampling optionalConcurrency-aware draft-length tuning evaluatedConfidence head not used—
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B coreSpeculative decoding coreTop-K candidate lattice coreLiLiCorr single-pass correlation head usedSemi-autoregressive drafting with sequential Markov correction usedStandalone parallel speculative drafters usedDFlash optionalDSpark optionalLiLiCorr optionalMTP draft-length configuration optionalProbabilistic draft sampling optionalConfidence head not used—
OpenVLA / OpenVLA-OFT usedGreedy decoding usedSecond-most-likely action querying usedSpeculative decoding mentionedDynamic action querying not used—
Qwen3.5-397B-A17B usedMTP-1 speculative decoding usedPresence penalty tuning usedMulti-Token Prediction optionalNEXTN speculative decoding optionalTask-specific sampling-parameter presets optional—
Qwen3.6-35B-A3B optionalMulti-Token Prediction optionalTask-specific sampling-parameter presets optional—
Qwen3.8-Flash-Next usedNEXTN speculative decoding usedMulti-Token Prediction optional—
SmolVLA evaluatedAction-chunk execution evaluated—
Step-3.7-Flash optionalEAGLE optionalMulti-layer EAGLE optional—
gpt-oss-120b usedGrammar-constrained decoding usedBest-of-N selection evaluated—
π0.5 defaultGreedy decoding defaultTemperature sampling for bimanual tasks optional—
↑