implementation detail · filed under post-training
Keep Sampling Mask
Keep Sampling Mask is an RL training technique that preserves the top-p/top-k truncation masks used when sampling from the old policy.1 Applying the same masks to the current policy keeps both policies in identical action subspaces, avoiding the importance-sampling mismatch that destabilizes training.2
How this definition was written
Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.
we preserve the truncation masks during sampling from and apply them to during training
— DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelsensuring both policies share identical action subspaces
— DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models