Open Models Almanac
Methodsdata curation

general family · filed under data curation

Data cleaning, processing, and modification

A broad curation family covering cleaning, processing, and modifying training datasets.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See data curation for the methods filed beside it.

sources
2
model
1
lab adopt it
1
strongest
used

Documented in

Thinking Machines Lab

Evidence

2 quotes from 2 sources, one card per model, each opening with its strongest.

How sources treat it
used 2

Inkling

Thinking Machines Labadopted2 sources

The training data curation process includes cleaning, processing, and modifying datasets.

useddata curationin InklingThinking Machines Lab
1 more from this model

Data curation includes cleaning, processing, and modifying datasets. These processing steps, which vary by data type, may include deduplication and filtering to remove junk or other low-quality data, or to advance safety or other objectives.

useddata curationin InklingThinking Machines Lab
↑