specific method · filed under data curation
Structural checks for malformed examples
Structural checks discard malformed examples, such as tool calls missing tool definitions.
Also called structural checks.
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
used 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
We first discard malformed examples using structural checks (e.g., missing tool definitions when tool calls are present).
useddata curationin Nemotron 3.5 LightningNVIDIA
Filed alongside
Other methods under data curation :: data filtering.
CSAM filteringSensitive data filteringCBRN pre-training data filteringFiltering batched auto-generated and templated contentHeuristic filteringKeyword- and regex-based filteringModel-based refusal and inability filteringPass@100 filteringPathological repetition filteringSmolVLM-based image-text quality scoringUnified data filtering pipelineAutomated verificationCoding-agent session filtering and trajectory deduplicationConservative model-based noise filteringContent quality and safety filteringContinuous contribution-score rankingData cleaningData filtering pipelineDense annotation of ambiguous low-quality dataDomain filtering with heuristics, classifier scoring, and deduplicationEvidence-based data cleaning and training constraintsFiltering low-information model-generated contentHeuristic and statistical filtering with deduplication and quality modelsImage-text relevance filtering