general family · filed under data curation
Data curation
The broad process of cleaning, processing, and modifying training datasets; the evidence does not specify a narrower procedure.
- sources
- 2
- model
- 1
- lab adopt it
- 1
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
used 2
Documented in
Evidence
2 spans quoted from the sources, strongest treatment first.
The training data curation process includes cleaning, processing, and modifying datasets.
useddata curationin InklingThinking Machines Lab
Data curation includes cleaning, processing, and modifying datasets. These processing steps, which vary by data type, may include deduplication and filtering to remove junk or other low-quality data, or to advance safety or other objectives.
useddata curationin InklingThinking Machines Lab
Filed alongside
Other methods under data curation.