Open Models Almanac
Methodsdata curationdata filtering

single mention · data curation

Dataset-pool cleanup, deduplication, and PII redaction

Curated datasets undergo cleanup, pool-wide exact deduplication, and personally identifiable information redaction.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See data filtering for the methods filed beside it.

Filed under data curation › data filtering