specific method · filed under post-training
Prefix-Conditioned On-Policy Distillation
On-policy distillation using prefixes to condition single-turn student rollouts.
Also called Prefix-Conditioned OPD, SFT-Prefix OPD, SFT-Prefix, Teacher-Prefix, Teacher-Prefix OPD.
- sources
- 2
- models
- 2
- lab adopt it
- 1
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
Documented in
Evidence
5 spans quoted from the sources, strongest treatment first.
add prefix-conditioned single-turn rollouts
Prefixes come from teacher rollouts (Teacher-Prefix OPD)
SFT data provide prefix contexts rather than fixed continuation targets.
prefix-conditioned single-turn rollouts (Teacher-Prefix and SFT-Prefix), reusing histories from teacher trajectories
prefix-conditioned single-turn rollouts (Teacher-Prefix and SFT-Prefix), reusing histories from teacher trajectories and SFT demonstrations
Filed alongside
Other methods under post-training :: policy distillation.