We then aggressively filter reasoning traces exhibiting pathological repetition, such as repeated n-grams within a sliding window or across the entire trajectory
specific method · filed under data curation
N-gram repetition filtering
Reasoning traces with pathological repeated n-grams, within a sliding window or across a trajectory, are removed.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See data filtering for the methods filed beside it.
Also called Pathological repetition filtering.
Documented in
Evidence
2 quotes from 2 sources, one card per model, each opening with its strongest.
How sources treat it
used 2
useddata curationin Nemotron 3.5 LightningNVIDIA
We then aggressively filter reasoning traces exhibiting pathological repetition, such as repeated n-grams within a sliding window or across the entire trajectory
useddata curationin Nemotron 3 UltraNVIDIA