Model techniques map
Techniquesdata curationsequence packing

specific method · filed under data curation

Length-aware best-fit packing

Packing multiple conversations by length into sequences up to a maximum context length.

Also called length-aware best-fit packing strategy.

sources
2
model
1
lab adopt it
1
strongest
used

How sources treat it

One count per evidence span, weakest treatment to strongest.

used 2

Documented in

Evidence

2 spans quoted from the sources, strongest treatment first.

we adopt a length-aware best-fit packing strategy (Ding et al., 2024), which packs multiple conversations into sequences up to a maximum context length.

useddata curationin Nemotron 3 UltraNVIDIA

adopt a length-aware best-fit packing strategy (ding2024fewer)

useddata curationin Nemotron 3 UltraNVIDIA

Filed alongside

Other methods under data curation :: sequence packing.