Open Models Almanac
Methodspost-trainingrollout & RL infrastructure

single mention · post-training

Capping trajectory staleness

Limits the age of trajectories used for training, with the cited implementation setting a cap of 10 optimizer steps.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See rollout & RL infrastructure for the methods filed beside it.

Filed under post-training › rollout & RL infrastructure