Open Models Almanac
Methodspost-trainingreinforcement learning algorithm

single mention · post-training

Stop-gradient upper-clipped importance weighting

Upper-clips the importance ratio and treats it as a constant via stop-gradient.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See reinforcement learning algorithm for the methods filed beside it.

Filed under post-training › reinforcement learning algorithm