Open Models Almanac
Methodspost-trainingrollout & RL infrastructure

single mention · post-training

Preserving the environment sampling mix

Draws an environment per group rather than per unit time so variable rollout durations do not distort the training mix.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See rollout & RL infrastructure for the methods filed beside it.

Also called Preserving the Environment Mix.

Filed under post-training › rollout & RL infrastructure