Open Models Almanac
Methodspost-trainingpolicy distillation

specific method · filed under post-training

Prefix-Conditioned On-Policy Distillation

Prefix-Conditioned On-Policy Distillation is a policy-distillation method that reuses trajectories from teacher rollouts or SFT demonstrations as prefix contexts.1,1 Each assistant-turn prefix initializes a separate student-generated turn that a domain teacher supervises token-level, rather than the student regenerating full rollouts.2

Trade-off Using SFT-demonstration prefixes limits student deviations in long-horizon tasks while the student still generates its own continuation instead of imitating a fixed response.3

How this definition was written

Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.

  1. Prefix-Conditioned OPD reuses trajectories from teacher rollouts (Teacher-Prefix OPD) or SFT data (SFT-Prefix OPD — MiMo V2 6 technical report
  2. A source trajectorywith 𝑘assistant-turndecisionpointsyields 𝑘completehistoryprefixes ℎ𝑖,eachofwhich can initialize a separate student-generated turn 𝑦𝑖 for token-level distillation by the relevant domain teacher — MiMo V2 6 technical report
  3. SFT-PrefixOPD thereforestartseachrolloutfromafixeddemonstrationprefix,limitingdeviationsbeforethesam- pled turn. Demonstrations supply the context, while the student generates its own continuation rather than imitating a fixed response — MiMo V2 6 technical report

Also called Prefix-Conditioned OPD, SFT-Prefix OPD, SFT-Prefix, Teacher-Prefix, Teacher-Prefix OPD.

sources
3
models
2
lab adopt it
1
strongest
used

Documented in

Evidence

6 quotes from 3 sources, one card per model, each opening with its strongest.

How sources treat it
used 6

MiMo-V2.6-Pro

Xiaomiadopted2 sources

reusing histories from teacher trajectories and SFT demonstrations so decision points train without regenerating preceding turns

usedpost trainingin MiMo-V2.6-Pro-RLXiaomi
3 more from this model

SFT data provide prefix contexts rather than fixed continuation targets.

usedunclearin MiMo-V2.6Xiaomi

add prefix-conditioned single-turn rollouts

usedunclearin MiMo-V2.6Xiaomi

Prefixes come from teacher rollouts (Teacher-Prefix OPD)

usedunclearin MiMo-V2.6Xiaomi

MiMo-V2.6-Flash

Xiaomiadopted2 sources

prefix-conditioned single-turn rollouts (Teacher-Prefix and SFT-Prefix), reusing histories from teacher trajectories and SFT demonstrations

usedpost trainingin MiMo-V2.6-Flash-RLXiaomi
4 more from this model

prefix-conditioned single-turn rollouts (Teacher-Prefix and SFT-Prefix), reusing histories from teacher trajectories

usedpost trainingin MiMo-V2.6-Flash-RLXiaomi

SFT data provide prefix contexts rather than fixed continuation targets.

usedunclearin MiMo-V2.6Xiaomi

add prefix-conditioned single-turn rollouts

usedunclearin MiMo-V2.6Xiaomi

Prefixes come from teacher rollouts (Teacher-Prefix OPD)

usedunclearin MiMo-V2.6Xiaomi
↑