Open Models Almanac
Methodspost-trainingpolicy distillation

methods · post-training

policy distillation

32 methods filed at this node or below it, from the sources of 19 models.

In this branch 32

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 32

Multi-Teacher On-Policy Distillation core · 21 sources · 29 quotes
On-Policy Distillation core · 6 sources · 8 quotes
Prefix-Conditioned On-Policy Distillation used · 3 sources · 6 quotes
Specialist Distillation used · 3 sources · 3 quotes
Distillation from a Larger Nemotron 3 Model used · 2 sources · 2 quotes
Distillation from Nemotron 3 Ultra Base used · 2 sources · 2 quotes
On-Policy Self-Distillation used · 2 sources · 4 quotes
24 from one source, or only mentioned as not used
Dual-Query Distillation core · 1 source · 1 quote
Token-Local Distillation Update core · 1 source · 1 quote
Autonomous Student Rollouts used · 1 source · 1 quote
Behavior–Proximal Policy Decoupling used · 1 source · 1 quote
Distillation on MiMo-Generated Data used · 1 source · 1 quote
Frozen Student Self-Anchor used · 1 source · 1 quote
IcePop Token-Level Loss Masking used · 1 source · 1 quote
Model Distillation used · 1 source · 1 quote
Multi-Teacher Capability Consolidation used · 1 source · 1 quote
Multiple-Teacher Distillation used · 1 source · 1 quote
On-Policy Cross-Stage Distillation used · 1 source · 2 quotes
Reasoning-Prefill Distillation used · 1 source · 3 quotes
Remote Teacher Infrastructure used · 1 source · 1 quote
Off-Policy Distillation not used · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

Modelmethods
DeepSeek-V4.1-Flash usedDynamic Post-Training Recipe Reconfiguration usedFull-Vocabulary On-Policy Distillation with Heterogeneous Teachers usedSFT–RL–On-Policy Distillation Post-Training Recipe used—
MiMo-V2.6-Flash usedAutonomous Student Rollouts usedDistillation on MiMo-Generated Data usedModel Distillation usedMulti-Prefix Multi-Teacher On-Policy Distillation usedPrefix-Conditioned On-Policy Distillation usedStandard Multi-Teacher On-Policy Distillation used—
NVIDIA-Nemotron-3-Ultra-550B-A55B coreMulti-Teacher On-Policy Distillation coreAsynchronous Multi-Teacher On-Policy Distillation usedBehavior–Proximal Policy Decoupling usedIcePop Token-Level Loss Masking usedOff-Policy Distillation not used—
DeepSeek-V4-Flash coreMulti-Teacher On-Policy Distillation coreOn-Policy Distillation used—
DeepSeek-V3.2 usedSpecialist Distillation used—
DeepSeek-V4-Pro coreMulti-Teacher On-Policy Distillation coreOn-Policy Distillation core—
GLM-5.2 usedOn-Policy Cross-Stage Distillation used—
Inkling usedDistillation-Based Post-Training Data Generation used—
Kimi K3 coreMulti-Teacher On-Policy Distillation corePer-Token On-Policy Distillation Reward with Clipping used—
Kolibri-1 usedOn-Policy Self-Distillation usedReasoning-Prefill Distillation used—
LFM3-1.7B usedMulti-Teacher On-Policy Distillation used—
LingBot-VLA 2.0 coreDual-Query Distillation core—
MiMo-V2.5 coreMulti-Teacher On-Policy Distillation coreOn-Policy Distillation used—
MiMo-V2.5-Pro coreMulti-Teacher On-Policy Distillation core—
MiMo-V2.6-Pro usedAutonomous Student Rollouts usedDistillation on MiMo-Generated Data usedModel Distillation usedMulti-Prefix Multi-Teacher On-Policy Distillation usedPrefix-Conditioned On-Policy Distillation usedStandard Multi-Teacher On-Policy Distillation used—
Mistral-Large-4 usedMulti-Teacher On-Policy Distillation usedMultiple-Teacher Distillation usedRemote Teacher Infrastructure usedThree-Teacher Distillation for Reasoning-Effort Modes used—
NVIDIA-Nemotron-3.5-Lightning-30B-A3B coreToken-Local Distillation Update coreDistillation from a Larger Nemotron 3 Model usedFrozen Student Self-Anchor usedMulti-Teacher On-Policy Distillation usedProximal-Teacher Trust-Region Policy Distillation usedTwo-Stage Multi-Teacher On-Policy Distillation used—
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B coreToken-Local Distillation Update coreDistillation from a Larger Nemotron 3 Model usedDistillation from Nemotron 3 Ultra Base usedFrozen Student Self-Anchor usedMulti-Teacher Capability Consolidation usedMulti-Teacher On-Policy Distillation usedProximal-Teacher Trust-Region Policy Distillation usedTwo-Stage Multi-Teacher On-Policy Distillation used—
Qwen3.5-397B-A17B usedOn-Policy Distillation usedSpecialist Distillation used—
↑