Open Models Almanac
Methodsdata curationdata filtering

specific method · filed under data curation

Filtering batched auto-generated and templated web content

Web-sourced data is screened to remove content produced in batches by automated generators or templates.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See data filtering for the methods filed beside it.

Also called Quality filtering against model collapse.

sources
2
models
2
lab adopt it
1
strongest
used

Documented in

Evidence

2 quotes from 2 sources, one card per model, each opening with its strongest.

How sources treat it
used 2

DeepSeek-V4-Pro

DeepSeekadopted2 sources

V4 implements strategies to remove batched auto-generated and templated content from web-sourced data.

useddata curationin DeepSeek-V4DeepSeek
1 more from this model

we implement filtering strategies to remove batched auto-generated and templated content

useddata curationin DeepSeek-V4DeepSeek
↑