Open Models Almanac
Methodsdata curationsequence packing

single mention · data curation

Smallest-overfill fallback with truncation

If no exact fit is found, the packer selects the smallest subset that overfills the sequence and truncates the excess tokens.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See sequence packing for the methods filed beside it.

Filed under data curation › sequence packing