Open Models Almanac
Methodsdata curationdata filtering

single mention · data curation

Equal-token-mass language-specific quality tiers

Each language's data is divided into five tiers with equal token mass.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See data filtering for the methods filed beside it.

Filed under data curation › data filtering