specific method · filed under data curation
Streaming training-data ingestion
Training data is streamed rather than read from local disk.
Also called stream training data.
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
used 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
We stream training data rather than reading it from local disk.
useddata curationin Model FactoryPoolside
Filed alongside
Other methods under data curation :: data sourcing.
Expert co-created training dataGitHub CrawlAgentic knowledge graph constructionCommon CrawlEssentialWebFinePDFsHigh-recall web-data curationImage-code pairs and computer-use trajectoriesLong-document curationNemotron-3-Ultra corpusNemotron-CCNemotron-Post-Training-v3Star-threshold-filtered GitHub repositoriesVideo frame extraction at 1 FPSVideo sampling parametersWeb knowledge graph construction and question generation