Open Models Almanac
Methodsdata curationdata filtering

methods · data curation

data filtering

145 methods filed at this node or below it, from the sources of 28 models.

In this branch 145

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 145

Benchmark decontamination core · 4 sources · 8 quotes
Heuristic filtering used · 4 sources · 4 quotes
CSAM filtering used · 3 sources · 3 quotes
Sensitive data filtering used · 3 sources · 3 quotes
CBRN safety filtering of pre-training data used · 2 sources · 2 quotes
Keyword- and regex-based content filtering used · 2 sources · 2 quotes
LLM-based refusal and inability filtering used · 2 sources · 2 quotes
Manual camera-viewpoint normalization used · 2 sources · 2 quotes
N-gram repetition filtering used · 2 sources · 2 quotes
Pass@100 filtering of synthesized RL tasks used · 2 sources · 2 quotes
Permissive-license filtering used · 2 sources · 2 quotes
Personally identifiable information redaction used · 2 sources · 2 quotes
PII-redaction-threshold document filtering used · 2 sources · 2 quotes
Unified data filtering pipeline used · 2 sources · 2 quotes
129 single mentions
Conservative model-based noise filtering core · 1 source · 1 quote
Masking fully missing depth patches core · 1 source · 1 quote
Minimum valid-frame coverage filtering core · 1 source · 1 quote
Multi-dimensional document quality scoring core · 1 source · 1 quote
Near-static episode filtering core · 1 source · 1 quote
Quality-bucket sampling core · 1 source · 1 quote
Trajectory-level quality control core · 1 source · 1 quote
Automated and LLM-based safety filtering used · 1 source · 1 quote
Automated anomaly screening used · 1 source · 1 quote
Automated verification used · 1 source · 1 quote
Benchmark reference-set coverage used · 1 source · 1 quote
Bidirectional match-span expansion used · 1 source · 1 quote
Candidate dataset audits used · 1 source · 1 quote
Content quality and safety filtering used · 1 source · 1 quote
Data cleaning used · 1 source · 1 quote
Data filtering pipeline used · 1 source · 1 quote
Excluding evaluation-style datasets used · 1 source · 1 quote
Filtering idle all-zero-action timesteps used · 1 source · 1 quote
Filtering idle trajectory segments used · 1 source · 1 quote
Five-word n-gram benchmark matching used · 1 source · 1 quote
GermanWeb classifier scoring used · 1 source · 1 quote
Heuristic language-consistency gate used · 1 source · 1 quote
Human screening of candidate SFT datasets used · 1 source · 1 quote
Idle-data filtering used · 1 source · 1 quote
Idle-frame filtering used · 1 source · 1 quote
Independent annotator quality checks used · 1 source · 1 quote
Language-specific filter retuning used · 1 source · 1 quote
Language-specific web-data filtering used · 1 source · 1 quote
License and codebase eligibility filtering used · 1 source · 1 quote
LLM-based language correction used · 1 source · 1 quote
Multi-dimensional data filtering used · 1 source · 1 quote
N-gram verbatim-overlap detection used · 1 source · 2 quotes
Quality checks for generated instances used · 1 source · 1 quote
Reference-answer compatibility auditing used · 1 source · 1 quote
Rule-based meta-action detection used · 1 source · 1 quote
Rule-based stylistic filtering of SFT data used · 1 source · 1 quote
Structural checks for malformed examples used · 1 source · 1 quote
Success-only episode filtering used · 1 source · 2 quotes
Three-stage question filtering used · 1 source · 1 quote
TOPReward dataset quality gate used · 1 source · 1 quote
TOPReward-based dataset quality filtering used · 1 source · 1 quote
Episode-boundary padding threshold filtering optional · 1 source · 1 quote
One-task-per-repository diversity filtering optional · 1 source · 1 quote
Classifier ensembling for data-quality annotation evaluated · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

Modelmethods
DeepSeek-V4.1-Flash usedFiltering and trajectory deduplication of coding-agent sessions used—
Hy3 usedData cleaning usedEvidence-based data cleaning and training constraints used—
NVIDIA-Nemotron-3-Ultra-550B-A55B usedAutomated verification usedData filtering pipeline usedHeuristic filtering usedKeyword- and regex-based content filtering usedN-gram repetition filtering used—
DeepSeek-V4-Flash usedFiltering batched auto-generated and templated web content used—
Alpamayo 1.5 / 2 Super usedDisagreement-based curation of RL post-training data usedIndependent annotator quality checks usedKeyframe selection for causal reasoning annotation usedKeyframe-range annotation for proactive scenarios usedRule-based meta-action detection usedRule-based scenario clip selection and balancing usedSafety exclusion filtering of invalid annotations used—
DeepSeek-V3.2 usedLLM-based refusal and inability filtering usedPass@100 filtering of synthesized RL tasks used—
DeepSeek-V4-Pro usedFiltering batched auto-generated and templated web content used—
GLM-5.2 usedThree-stage question filtering used—
GR00T N1.7 usedFiltering and re-captioning generated neural trajectories usedInstruction-adherence filtering of generated videos usedSuccess-based filtering of simulated demonstrations used—
Gemma 4 31B usedBenchmark decontamination usedContent quality and safety filtering usedCSAM filtering usedpost-training data filtering for safety and factuality usedSensitive data filtering used—
Kimi K3 usedDomain filtering with heuristics, classifier scoring, and deduplication usedLong-context data cleaning and filtering pipeline used—
Kolibri-1 coreBenchmark decontamination coreShared canonical-format SFT data processing pipeline coreAveraging quality and grammar classifier scores usedBenchmark reference-set coverage usedBidirectional match-span expansion usedBlind adjudication of disputed answer options usedCandidate dataset audits usedContent-overlap filtering of candidate datasets usedDataset-pool cleanup, deduplication, and PII redaction usedDifficulty-based filtering of long-context training questions usedDistilling LLM-judge annotation axes into binary classifiers usedEqual-token-mass language-specific quality tiers usedExact-match requirement for short contamination spans usedExcluding datasets with crawler opt-out violations usedExcluding datasets with source-level infringement indications usedFastText classifier for SFT-style data quality usedFiltering synthetic generations for artifacts and errors usedFive-word n-gram benchmark matching usedGermanWeb classifier scoring usedHarmful and unsuitable training-data filtering usedHeuristic filtering and language-based routing usedHeuristic language-consistency gate usedHeuristic web-document filtering and cleanup usedLanguage-specific fastText routing and filtering usedLanguage-specific filter retuning usedLanguage-specific web-data filtering usedLLM-based language correction usedN-gram-based benchmark contamination detection usedPattern filtering of foreign model or lab identity claims usedPersonally identifiable information redaction usedPII-redaction-threshold document filtering usedQuality classification for quality-aware data mixing usedReference-answer filtering of generated solutions usedRemoving English reasoning from non-English SFT exchanges usedRemoving synthetic long documents from the long-context mix usedRetaining answers while removing malformed or language-switching reasoning usedSimplex-weighted mixture of document annotation scores usedTest-based filtering of generated software-fix trajectories usedTraining-data filtering and personal-data redaction usedURL-list filtering for unsafe or infringing sources usedWithin-benchmark inverse document frequency usedClassifier ensembling for data-quality annotation evaluatedFastText, embedding-MLP, and fine-tuned BERT classifier comparison evaluated—
LFM3-1.7B coreMulti-stage SFT quality filtering and decontamination coreAutomated and LLM-based safety filtering usedBenchmark decontamination by n-gram and semantic matching usedHuman screening of candidate SFT datasets usedRule-based and LLM-judged audio data filtering usedRule-based stylistic filtering of SFT data used—
Laguna-S-2.1 coreConservative model-based noise filtering coreMulti-dimensional document quality scoring coreQuality-bucket sampling coreRanking retained documents by continuous contribution score coreDense annotation of ambiguous low-quality data usedPCA-based dimension selection for decorrelated quality signals usedPropella multi-property document annotation usedTwo-axis document-quality labeling by noise and information usedOne-task-per-repository diversity filtering optional—
LingBot-VLA 2.0 coreDataset normalization statistics computation coreHuman verification of robot state and video alignment coreMasking fully missing depth patches coreMinimum valid-frame coverage filtering coreNear-static episode filtering coreProbabilistic masking of partially valid depth patches coreRandom sampling of fully valid depth tokens coreRobotic trajectory quality filtering pipeline coreTrajectory smoothness filtering using jerk and derivative Z-scores coreTrajectory-level quality control coreVision-language-model filtering of egocentric videos coreAutomated anomaly screening usedHuman review of filtered demonstration episodes usedLeft-right consistency checking for stereo pseudo-depth used—
MiMo-V2.5 usedMulti-dimensional data filtering used—
MiMo-V2.5-Pro usedMulti-dimensional data filtering used—
Mistral-Large-4 usedQuality checks for generated instances used—
MolmoAct 2 coreLow-frame-rate video sampling with an eight-frame cap coreExcluding evaluation-style datasets usedFiltering no-op actions and unsuccessful demonstrations usedFour-stage quality filtering for community SO-100/101 robot data usedIdle-frame filtering usedLicense and codebase eligibility filtering usedNormalize task strings into natural-language instructions usedStructural validation of robot dataset samples usedTOPReward dataset quality gate usedTOPReward-based dataset quality filtering used—
NVIDIA-Nemotron-3.5-Lightning-30B-A3B usedAutomated quality filtering of synthetic vision data usedBenchmark decontamination usedBenchmark decontamination and secret removal from training sources usedDifficulty filtering for tool-dependent training examples usedHeuristic filtering usedKeyword- and regex-based content filtering usedMinimum-length filtering for reasoning SFT data usedN-gram repetition filtering usedN-gram verbatim-overlap detection usedNormalize training samples to their problem statements usedOutcome- and execution-based filtering of agentic trajectories usedPer-question retrieval of contamination candidates usedPermissive-license filtering usedReference-answer compatibility auditing usedSeverity-thresholded benchmark contamination removal usedStructural checks for malformed examples usedTranslation quality-score threshold filtering usedUnified data filtering pipeline used—
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B usedAutomated quality filtering of synthetic vision data usedBenchmark decontamination usedBenchmark decontamination and secret removal from training sources usedDifficulty filtering for tool-dependent training examples usedHeuristic filtering usedMinimum-length filtering for reasoning SFT data usedN-gram verbatim-overlap detection usedNormalize training samples to their problem statements usedOutcome- and execution-based filtering of agentic trajectories usedPer-question retrieval of contamination candidates usedPermissive-license filtering usedReference-answer compatibility auditing usedSeverity-thresholded benchmark contamination removal usedSynthetic trajectory filtering for correctness, repetition, and validity usedTranslation quality-score threshold filtering used—
OpenVLA / OpenVLA-OFT coreRobot dataset filtering by camera view and control type coreFiltering no-op actions and unsuccessful demonstrations usedFirst-transition removal from demonstrations usedSimulation replay filtering of demonstrations used—
SmolVLA usedCommunity robotics dataset filtering by metadata and quality usedJoint-space similarity filtering of observations usedManual camera-viewpoint normalization usedManual review of candidate robotics datasets usedRobotics dataset selection by frame count, visual quality, and task coverage used—
VLA Foundry (Foundry-VLA-1.7B) usedNormalize and concatenate configured proprioceptive fields usedEpisode-boundary padding threshold filtering optional—
X-VLA mentionedPrivacy-sensitive content filtering and bias mitigation mentioned—
Xiaomi-Robotics-1 usedFiltering idle trajectory segments used—
gpt-oss-120b usedCBRN safety filtering of pre-training data used—
π0.5 usedFiltering idle all-zero-action timesteps usedIdle-data filtering usedPer-dataset action-dimension quantile normalization usedRandom image crop, resize, rotation, and color-jitter augmentation usedSuccess-only episode filtering used—
↑