Open Models Almanac
Methodsdata curation

methods · pipeline stage 1 of 6

data curation

532 methods filed at this node or below it, from the sources of 38 models.

In this branch 532

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 11

Chain of Causation (CoC) labeling framework core · 2 sources · 2 quotes
Data cleaning, processing, and modification used · 2 sources · 2 quotes
Deduplication and filtering used · 2 sources · 2 quotes
8 single mentions
Past/future action-window sampling core · 1 source · 1 quote
Robot data feature mapping core · 1 source · 1 quote
Standardized robotics data conversion core · 1 source · 1 quote
Large-scale multimodal pretraining data used · 1 source · 1 quote
Multilingual corpus expansion used · 1 source · 1 quote
Nemotron-CC pipeline used · 1 source · 1 quote
Product co-design for training data used · 1 source · 1 quote

data sourcing 37

Expert co-created training data used · 2 sources · 2 quotes
GitHub Crawl used · 2 sources · 2 quotes
34 single mentions
Bilingual German-English data curation core · 1 source · 1 quote
Conversion to WebDataset tar shards core · 1 source · 1 quote
EgoScale core · 1 source · 1 quote
Pre-training on sensorized human video core · 1 source · 1 quote
Real-world robot-data pre-training core · 1 source · 1 quote
Common Crawl used · 1 source · 1 quote
Community-driven data used · 1 source · 1 quote
DAgger-style data collection used · 1 source · 1 quote
EssentialWeb used · 1 source · 1 quote
Evenly spaced video-frame sampling used · 1 source · 1 quote
FinePDFs used · 1 source · 1 quote
High-recall web-data curation used · 1 source · 1 quote
Long-context training-data construction used · 1 source · 1 quote
Long-document curation used · 1 source · 1 quote
Nemotron-3-Ultra corpus used · 1 source · 1 quote
Nemotron-CC used · 1 source · 1 quote
Nemotron-Post-Training-v3 used · 1 source · 1 quote
Pre-training on Open X-Embodiment data used · 1 source · 1 quote
Resampling training data used · 1 source · 1 quote
Video frame extraction at 1 FPS used · 1 source · 1 quote
Web-data training used · 1 source · 1 quote
Multimodal processor video-sampling parameters optional · 1 source · 1 quote
Internal offline web mentioned · 1 source · 1 quote

data filtering 145

Benchmark decontamination core · 4 sources · 8 quotes
Heuristic filtering used · 4 sources · 4 quotes
CSAM filtering used · 3 sources · 3 quotes
Sensitive data filtering used · 3 sources · 3 quotes
CBRN safety filtering of pre-training data used · 2 sources · 2 quotes
Keyword- and regex-based content filtering used · 2 sources · 2 quotes
LLM-based refusal and inability filtering used · 2 sources · 2 quotes
Manual camera-viewpoint normalization used · 2 sources · 2 quotes
N-gram repetition filtering used · 2 sources · 2 quotes
Pass@100 filtering of synthesized RL tasks used · 2 sources · 2 quotes
Permissive-license filtering used · 2 sources · 2 quotes
Personally identifiable information redaction used · 2 sources · 2 quotes
PII-redaction-threshold document filtering used · 2 sources · 2 quotes
Unified data filtering pipeline used · 2 sources · 2 quotes
129 single mentions
Conservative model-based noise filtering core · 1 source · 1 quote
Masking fully missing depth patches core · 1 source · 1 quote
Minimum valid-frame coverage filtering core · 1 source · 1 quote
Multi-dimensional document quality scoring core · 1 source · 1 quote
Near-static episode filtering core · 1 source · 1 quote
Quality-bucket sampling core · 1 source · 1 quote
Trajectory-level quality control core · 1 source · 1 quote
Automated and LLM-based safety filtering used · 1 source · 1 quote
Automated anomaly screening used · 1 source · 1 quote
Automated verification used · 1 source · 1 quote
Benchmark reference-set coverage used · 1 source · 1 quote
Bidirectional match-span expansion used · 1 source · 1 quote
Candidate dataset audits used · 1 source · 1 quote
Content quality and safety filtering used · 1 source · 1 quote
Data cleaning used · 1 source · 1 quote
Data filtering pipeline used · 1 source · 1 quote
Excluding evaluation-style datasets used · 1 source · 1 quote
Filtering idle all-zero-action timesteps used · 1 source · 1 quote
Filtering idle trajectory segments used · 1 source · 1 quote
Five-word n-gram benchmark matching used · 1 source · 1 quote
GermanWeb classifier scoring used · 1 source · 1 quote
Heuristic language-consistency gate used · 1 source · 1 quote
Human screening of candidate SFT datasets used · 1 source · 1 quote
Idle-data filtering used · 1 source · 1 quote
Idle-frame filtering used · 1 source · 1 quote
Independent annotator quality checks used · 1 source · 1 quote
Language-specific filter retuning used · 1 source · 1 quote
Language-specific web-data filtering used · 1 source · 1 quote
License and codebase eligibility filtering used · 1 source · 1 quote
LLM-based language correction used · 1 source · 1 quote
Multi-dimensional data filtering used · 1 source · 1 quote
N-gram verbatim-overlap detection used · 1 source · 2 quotes
Quality checks for generated instances used · 1 source · 1 quote
Reference-answer compatibility auditing used · 1 source · 1 quote
Rule-based meta-action detection used · 1 source · 1 quote
Rule-based stylistic filtering of SFT data used · 1 source · 1 quote
Structural checks for malformed examples used · 1 source · 1 quote
Success-only episode filtering used · 1 source · 2 quotes
Three-stage question filtering used · 1 source · 1 quote
TOPReward dataset quality gate used · 1 source · 1 quote
TOPReward-based dataset quality filtering used · 1 source · 1 quote
Episode-boundary padding threshold filtering optional · 1 source · 1 quote
One-task-per-repository diversity filtering optional · 1 source · 1 quote
Classifier ensembling for data-quality annotation evaluated · 1 source · 1 quote

deduplication 15

Corpus deduplication used · 5 sources · 5 quotes
Exact text deduplication used · 2 sources · 2 quotes
13 single mentions
CMinHash locality-sensitive hashing used · 1 source · 1 quote
Exact question–answer deduplication used · 1 source · 1 quote
Exact text deduplication by xxHash used · 1 source · 1 quote
In-pack deduplication used · 1 source · 1 quote
Retain-one substring removal used · 1 source · 1 quote
Semantic deduplication used · 1 source · 1 quote
Snapshot-level fuzzy deduplication used · 1 source · 1 quote
Substring deduplication used · 1 source · 2 quotes
Token 3-gram Jaccard verification used · 1 source · 1 quote

synthetic data 138

Large-scale agentic task synthesis pipeline core · 3 sources · 3 quotes
Synthetic data generation used · 3 sources · 3 quotes
Counterfactual data augmentation mentioned · 2 sources · 2 quotes
128 single mentions
Gaussian-noise augmentation of depth maps used · 1 source · 1 quote
Knowledge-graph-guided task synthesis used · 1 source · 1 quote
Metadata-conditioned synthetic generation used · 1 source · 1 quote
Minimal-tool autonomous task authoring used · 1 source · 1 quote
Regenerate training-data completions used · 1 source · 2 quotes
Rubric-guided RL data used · 1 source · 1 quote
Synthetic English pre-training rephrasing used · 1 source · 1 quote
Synthetic environment generation pipelines used · 1 source · 1 quote
Synthetic German web-data rephrasing used · 1 source · 1 quote
Synthetic privacy-preserving personas used · 1 source · 1 quote
Task-specific data injection used · 1 source · 1 quote
Template-based synthetic data generation used · 1 source · 1 quote
User-simulated conversational continuation used · 1 source · 3 quotes
VLM-based offline automatic CoC labeling used · 1 source · 1 quote
Co-training with generated neural trajectories evaluated · 1 source · 1 quote

data mixture & curriculum 117

Heterogeneous training mixture core · 2 sources · 2 quotes
Heterogeneous-data co-training core · 2 sources · 4 quotes
Curated higher-quality mid-training data used · 3 sources · 4 quotes
Cross-embodiment robot training used · 2 sources · 2 quotes
KL-regularized data-mixture optimization used · 2 sources · 3 quotes
MergeMix used · 2 sources · 4 quotes
MergeMix expert-checkpoint merging used · 2 sources · 3 quotes
Vulnerability-discovery training data used · 2 sources · 2 quotes
109 from one source, or only mentioned as not used
AutoMixer core · 1 source · 2 quotes
Cross-domain and cross-trajectory shuffling core · 1 source · 2 quotes
Dataloader-time dataset mixing core · 1 source · 1 quote
Heterogeneous training data pyramid core · 1 source · 1 quote
Open X-Embodiment dataset mixture core · 1 source · 1 quote
Probabilistic multi-modal dataset mixing core · 1 source · 1 quote
Sample Mixer core · 1 source · 1 quote
Weighted dataset-proportion mixing core · 1 source · 1 quote
Weighted multi-dataset mixing core · 1 source · 1 quote
Three-bucket training curriculum default · 1 source · 1 quote
Agent-centric multimodal data mixture used · 1 source · 1 quote
Blind pairwise bucket-boundary calibration used · 1 source · 1 quote
Combined per-band sampling budgets used · 1 source · 1 quote
Cross-embodied robot data mixture used · 1 source · 1 quote
Curriculum-driven data loading used · 1 source · 1 quote
Data Scheduler used · 1 source · 1 quote
Dirichlet sampling of data-mixture weights used · 1 source · 2 quotes
Episode-level camera-order randomization used · 1 source · 3 quotes
Four-epoch dataset repetition cap used · 1 source · 1 quote
Heterogeneous data-mixture batch sampling used · 1 source · 1 quote
Interleave bulk-shuffled dataset indices used · 1 source · 1 quote
Interleaved mixed-modality training used · 1 source · 1 quote
Interleaved multimodal data used · 1 source · 1 quote
Joint multi-task training used · 1 source · 1 quote
Joint vision-language and action training used · 1 source · 1 quote
Multi-task batch mixing used · 1 source · 1 quote
Multi-task training used · 1 source · 1 quote
Multimodal web-data co-training used · 1 source · 1 quote
Octo dataset-mixture weighting used · 1 source · 1 quote
Paired side-and-wrist camera-view examples used · 1 source · 1 quote
Preserve natural training-data format used · 1 source · 1 quote
Reasoning-focused RL curriculum used · 1 source · 1 quote
Skill-specific SFT mixture design used · 1 source · 1 quote
Text-to-multimodal data annealing schedule used · 1 source · 1 quote
Three-stage data mixture strategy used · 1 source · 1 quote
Three-stage pre-training curriculum used · 1 source · 1 quote
Training on subtask-prediction data used · 1 source · 1 quote
Transparent tokenizer training mixture used · 1 source · 1 quote
Two-axis mid-training data mixing used · 1 source · 1 quote
Two-phase curriculum used · 1 source · 1 quote
Upsampling long-context data used · 1 source · 1 quote
Video-dominant pre-training data used · 1 source · 1 quote
Within-batch mixing of training sources used · 1 source · 1 quote
Weighted multi-dataset fine-tuning optional · 1 source · 1 quote
Fixed-budget Indic mixture-ratio ablations evaluated · 1 source · 1 quote
ProtocolQA-aligned RL training datasets evaluated · 1 source · 1 quote
Training data mixing evaluated · 1 source · 1 quote
Uniformly upsample German SFT data evaluated · 1 source · 1 quote
Fixed-ratio environment sampling not used · 1 source · 1 quote

sequence packing 27

Length-aware best-fit packing used · 2 sources · 2 quotes
Packed-sequence training for long contexts used · 2 sources · 2 quotes
Sequence packing used · 2 sources · 2 quotes
24 single mentions
Cost-aware longest-first bin packing core · 1 source · 2 quotes
Next-k-Fit core · 1 source · 1 quote
Bin packing of document chunks used · 1 source · 1 quote
Cross-source document packing used · 1 source · 1 quote
Exact-length sequence bin packing used · 1 source · 2 quotes
Fixed-cap action-chunk packing used · 1 source · 1 quote
Group-local sequence packing used · 1 source · 1 quote
Multi-stage robotics data preprocessing used · 1 source · 1 quote
Oldest-chunk anchoring used · 1 source · 1 quote
Quantized sequence packing used · 1 source · 1 quote
Random Sequential Document Buffer (RSDB) used · 1 source · 2 quotes
RSDB document chunking used · 1 source · 1 quote
Smallest-overfill fallback with truncation used · 1 source · 1 quote
Subset-sum sequence filling used · 1 source · 1 quote
Vision-language token sequence packing used · 1 source · 1 quote
Configurable sequence padding optional · 1 source · 1 quote

tokenization 42

Quantile normalization of robot actions core · 2 sources · 2 quotes
UniBPE used · 3 sources · 4 quotes
Quick Instruction tokens used · 2 sources · 2 quotes
38 single mentions
ChatML core · 1 source · 1 quote
FAST action tokenizer core · 1 source · 1 quote
FAST+ core · 1 source · 4 quotes
German morphology-aware tokenization core · 1 source · 1 quote
Quantile-bounded action discretization core · 1 source · 1 quote
Robot-specific token interface core · 1 source · 1 quote
XTML core · 1 source · 1 quote
128K-token vocabulary used · 1 source · 1 quote
Bilingual English-German tokenizer used · 1 source · 1 quote
Byte-level byte-pair encoding used · 1 source · 1 quote
Column-first DCT-coefficient flattening used · 1 source · 1 quote
DCT-BPE action compression used · 1 source · 1 quote
Discrete action-token representation used · 1 source · 1 quote
Greedy bottom-up BPE merging used · 1 source · 1 quote
MolmoAct2-FAST Tokenizer used · 1 source · 2 quotes
o200k_harmony tokenizer used · 1 source · 1 quote
o200k_harmony vocabulary used · 1 source · 1 quote
Padding actions to 32 dimensions used · 1 source · 1 quote
SentencePiece used · 1 source · 1 quote
Trie-based tokenization used · 1 source · 1 quote
Unigram-objective merge selection used · 1 source · 1 quote
Selectable robot-output styles optional · 1 source · 1 quote
FAST action-token training evaluated · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

Modelfiled heredata sourcingdata filteringdeduplicationsynthetic datadata mixture & curriculumsequence packingtokenization
GLM-5.3-Flash used———————Chat-template image/video placeholder expansion used—
DeepSeek-V4.1-Flash coreLarge-scale multimodal pretraining data used—Star-threshold filtering of public GitHub repositories usedVoluntary workflow interaction-data collection used—Filtering and trajectory deduplication of coding-agent sessions used——Automated large-scale data synthesis and environment construction coreAutomated synthesis of agent tasks and environments with progressive scaling coreProcedural construction and scaling of interactive agent environments coreSynthesis of verifiable training tasks, reference solutions, and reward signals coreAgent screening of coding projects for container execution and automatic verification usedAgent-designed coding tasks with fail-to-pass and pass-to-pass evaluation points usedIterative reward-guided training for task construction used—Filtering, deduplication, and difficulty calibration of synthesized data core———
Hy4-preview usedProduct co-design for training data used—Expert co-created training data used———Training-data construction around expert work products used————
GLM-5.3 used————Synthetic environment generation pipelines usedTraining with vulnerability-focused data and environments usedVerifier synthesis without reference solution used—Vulnerability-discovery training data used———
Hy3 used——Data cleaning usedEvidence-based data cleaning and training constraints used——————
MiMo-V2.6-Flash core————Automated large-scale data synthesis and environment construction usedMulti-agent synthesis of local software mocks for reproducible environments usedTraining SFT teachers on synthetic demonstrations for open-domain tasks used—Sample Mixer coreAgent-centric multimodal data mixture usedData Scheduler usedDynamic sampling for mixed-task reinforcement learning usedSmooth weighted round-robin source scheduling used—Group-local sequence packing used——
NVIDIA-Nemotron-3-Ultra-550B-A55B usedNemotron-CC pipeline used—Common Crawl usedEssentialWeb usedFinePDFs usedGitHub Crawl usedNemotron-3-Ultra corpus usedNemotron-CC usedNemotron-Post-Training-v3 used—Automated verification usedData filtering pipeline usedHeuristic filtering usedKeyword- and regex-based content filtering usedN-gram repetition filtering used—Corpus deduplication usedIn-pack deduplication used—Knowledge distillation for synthetic data generation usedSynthetic data generation usedCounterfactual data augmentation mentioned—Gaussian-based data-mixture and curriculum construction usedTwo-phase curriculum used—Length-aware best-fit packing used——
DeepSeek-V4-Flash used——Filtering batched auto-generated and templated web content used————Cross-source document packing used—Quick Instruction tokens used—
Alpamayo 1.5 / 2 Super coreChain of Causation (CoC) labeling framework core——Disagreement-based curation of RL post-training data usedIndependent annotator quality checks usedKeyframe selection for causal reasoning annotation usedKeyframe-range annotation for proactive scenarios usedRule-based meta-action detection usedRule-based scenario clip selection and balancing usedSafety exclusion filtering of invalid annotations used——Causally grounded, decision-linked reasoning traces coreTemporal separation of historical and future inputs in CoC auto-labeling usedVLM-based automatic labeling with heuristic rules usedVLM-based offline automatic CoC labeling used———Single-image tokenization for multi-camera video inputs defaultDiscrete action-token representation used—
DeepSeek-V3.2 core——LLM-based refusal and inability filtering usedPass@100 filtering of synthesized RL tasks used——Automatic synthesis of task-oriented RL environments coreLarge-scale agentic task synthesis pipeline coreAutomated environment, toolset, task, and solution synthesis pipeline usedCode-agent environment construction from GitHub issue-PR pairs usedHeterogeneous answer-generation agents producing diverse candidate responses usedIterative task-difficulty escalation with solution and verifier updates usedMulti-agent pipeline for search-agent training data generation usedQuestion-construction agent that explores entities with search tools usedSearch-capable verification agent for answer validation used————
DeepSeek-V4-Pro usedMultilingual corpus expansion used—Long-document curation used—Filtering batched auto-generated and templated web content used——Rubric-guided RL data usedTask-specific data injection used——Cross-source document packing used—Quick Instruction tokens used—
FLUX 3 Action used—Video-game and first-person human-hand footage used————Video-dominant pre-training data used———
GLM-5.2 used—Web knowledge graph construction and question generation used—Three-stage question filtering used——Agent-based synthetic-data generation pipeline used————
GR00T N1.7 core—EgoScale corePre-training on sensorized human video core—Filtering and re-captioning generated neural trajectories usedInstruction-adherence filtering of generated videos usedSuccess-based filtering of simulated demonstrations used——Inverse-dynamics-model pseudo-action labeling usedNeural trajectory generation using video generative models usedOWL-v2 target-object bounding-box annotation usedRecaptioning videos that fail instruction-adherence review usedSimulation trajectory generation through demonstration transformation and replay usedCo-training with generated neural trajectories evaluated—Co-training on synthetic and real-world data coreHeterogeneous training data pyramid coreHeterogeneous training mixture core1:1 co-training of real-world and neural trajectories usedHeterogeneous data-mixture batch sampling usedHeterogeneous-data co-training usedWeighted multi-dataset fine-tuning optional———
Gemma 4 31B used—Video frame extraction at 1 FPS used—Benchmark decontamination usedContent quality and safety filtering usedCSAM filtering usedpost-training data filtering for safety and factuality usedSensitive data filtering used———In-context attribution, hedging, and refusal data subsets used——SentencePiece usedSeparate end tokens for pretraining and instruction-tuned models used—
Inkling usedData cleaning, processing, and modification usedDeduplication and filtering used————Randomized tool set and schema during training usedSynthetic data generation used————
Kimi K3 core—Agent-driven recursive knowledge graph construction used—Domain filtering with heuristics, classifier scoring, and deduplication usedLong-context data cleaning and filtering pipeline used——Agentic visual reasoning with a Python interpreter in a sandbox usedKnowledge and mathematics corpus rephrasing with fidelity verification usedKnowledge-graph-guided task synthesis usedMulti-stage verification with human-in-the-loop annotation usedProgrammatic multimodal data coupling code with rendered visuals usedSynthetic long-context data via permutation and concatenation of multimodal documents usedSynthetic trajectory generation with domain-specialized models used—Upsampling long-context data used——XTML core—
Kolibri-1 coreGerman web-data curation and synthetic data generation used—Bilingual German-English data curation coreThird-party data-source compliance screening coreLong-context training-data construction usedThird-party data-source provenance screening used—Benchmark decontamination coreShared canonical-format SFT data processing pipeline coreAveraging quality and grammar classifier scores usedBenchmark reference-set coverage usedBidirectional match-span expansion usedBlind adjudication of disputed answer options usedCandidate dataset audits usedContent-overlap filtering of candidate datasets usedDataset-pool cleanup, deduplication, and PII redaction usedDifficulty-based filtering of long-context training questions usedDistilling LLM-judge annotation axes into binary classifiers usedEqual-token-mass language-specific quality tiers usedExact-match requirement for short contamination spans usedExcluding datasets with crawler opt-out violations usedExcluding datasets with source-level infringement indications usedFastText classifier for SFT-style data quality usedFiltering synthetic generations for artifacts and errors usedFive-word n-gram benchmark matching usedGermanWeb classifier scoring usedHarmful and unsuitable training-data filtering usedHeuristic filtering and language-based routing usedHeuristic language-consistency gate usedHeuristic web-document filtering and cleanup usedLanguage-specific fastText routing and filtering usedLanguage-specific filter retuning usedLanguage-specific web-data filtering usedLLM-based language correction usedN-gram-based benchmark contamination detection usedPattern filtering of foreign model or lab identity claims usedPersonally identifiable information redaction usedPII-redaction-threshold document filtering usedQuality classification for quality-aware data mixing usedReference-answer filtering of generated solutions usedRemoving English reasoning from non-English SFT exchanges usedRemoving synthetic long documents from the long-context mix usedRetaining answers while removing malformed or language-switching reasoning usedSimplex-weighted mixture of document annotation scores usedTest-based filtering of generated software-fix trajectories usedTraining-data filtering and personal-data redaction usedURL-list filtering for unsafe or infringing sources usedWithin-benchmark inverse document frequency usedClassifier ensembling for data-quality annotation evaluatedFastText, embedding-MLP, and fine-tuned BERT classifier comparison evaluated—Chronological duplicate retention across snapshots usedCorpus deduplication usedDigit-placeholder normalization and token 5-gram shingling usedExact text deduplication usedExact text deduplication by xxHash usedLanguage-sharded chronological snapshot assignment usedMinHash locality-sensitive hashing fuzzy deduplication usedRetain-one substring removal usedSubstring deduplication usedToken 3-gram Jaccard verification used—Abstention training with explicit negative examples usedAdd synthesized long-context conversations to the SFT mix usedBackfilling missing reasoning between tool calls usedConcatenate tool-use conversations into long-context synthesis tasks usedEnglish-to-German translation for data augmentation usedGenerate fully German reasoning-training samples usedGenerate unanswerable examples by masking context with helpful and adversarial agents usedGerman document rephrasing for data augmentation usedGerman reasoning prefill for synthetic teacher traces usedMerlin-Arthur synthetic negative-example generation procedure usedMulti-hop retrieval task synthesis using GLM-5.2 usedReference-blind German rewriting of math and science problems usedRegenerate training-data completions usedRegeneration of reasoning traces for agentic SFT data usedRetain both reasoning and non-reasoning trajectory variants usedSearch-dependence filtering for multi-hop questions usedSection-grounded simulated requests for long-context training usedSeeded planning of long-context question locations and answer shape usedSpread long-context queries across document sections usedSynthetic data generation usedSynthetic English pre-training rephrasing usedSynthetic German web-data rephrasing usedSynthetic German-language data for supervised fine-tuning usedSynthetic multi-hop retrieval-question generation usedSynthetic-data training environments for domain-specific skills usedTemplate-based synthetic data generation usedTrain value judgments using everyday requests without explicit ethical cues usedTrain with full-context, Merlin-masked, and Morgana-masked question variants usedUser-simulated conversational continuation usedVerifiable terminal-task generation by injecting repository bugs used—Adaptive RL prompt and environment curriculum corePreserve pre-training dataset proportions in mid-training defaultThree-bucket training curriculum defaultBisection for shared reweighting-scale selection usedCombined per-band sampling budgets usedDirichlet sampling of data-mixture weights usedEmpirical pre- and mid-training data-mix selection usedFastText-quality gating of annotation scores usedFour-epoch dataset repetition cap usedGaussian-process surrogate optimization of annotation weights usedInterleave bulk-shuffled dataset indices usedKL-regularized data-mixture optimization usedLength-based reweighting of mid-training data usedLinear interpolation from pre-training mix to mid-training mix usedLog-linear benchmark models for optimizing mid-training domain weights usedLog-linear proxy model for predicting benchmark BPB from data mixture usedMergeMix usedMergeMix expert-checkpoint merging usedMid-rank normalization of annotation scores usedOptimize annotation mixture weights against proxy-model BPB usedPer-source repetition caps in data-mixture optimization usedProxy-model mixture selection using fitted mixing laws usedSFT sampling proportional to unique-token counts usedShard-proportional batch sampling by multivariate hypergeometric draw usedShuffle buffer for conversation-level batch balance usedTraining-data bias mitigation through reweighting and augmentation usedTwo-axis mid-training data mixing usedUpweighting selected agentic and competitive-programming environments usedWater-filling redistribution under repetition caps usedTraining data mixing evaluatedUniformly upsample German SFT data evaluatedVarying math-to-code proportions in a training data mix evaluatedFixed-ratio environment sampling not used—Cost-aware longest-first bin packing coreNext-k-Fit coreBin packing of document chunks usedExact-length sequence bin packing usedFixed-length conversation packing with document-masked attention usedOldest-chunk anchoring usedPer-rank buffering and ordering by attention cost usedRandom Sequential Document Buffer (RSDB) usedRSDB document chunking usedSmallest-overfill fallback with truncation usedSubset-sum sequence filling usedUniform random buffered-document chunk selection used—German morphology-aware tokenization coreBilingual English-German tokenizer usedGreedy bottom-up BPE merging usedOnline document tokenization with end-of-sequence markers usedUniBPE usedUniBPE and standard-BPE vocabulary construction usedUnigram-objective merge selection used—
LFM3-1.7B core—Multilingual vision-language training through translated data used—Multi-stage SFT quality filtering and decontamination coreAutomated and LLM-based safety filtering usedBenchmark decontamination by n-gram and semantic matching usedHuman screening of candidate SFT datasets usedRule-based and LLM-judged audio data filtering usedRule-based stylistic filtering of SFT data used—CMinHash locality-sensitive hashing usedExact text deduplication usedSemantic deduplication used—Conversion of text SFT datasets into synthetic audio conversations usedDataset recaptioning for multimodal training usedOn-policy preference-data generation and skill-specific refinement usedSynthetic multi-turn audio conversation data generation usedSynthetic paralinguistic and discourse feature generation usedSynthetic VQA generation targeted at visual understanding usedTheme-conditioned synthetic audio conversation generation usedVisual augmentation for robust document OCR usedVoice cloning to diversify synthetic user voices used—Curated higher-quality mid-training data usedDifficulty-ordered SFT curriculum based on ensemble solve rates usedMain pre-training with an expanded domain mix usedSkill-specific SFT mixture design usedText-to-multimodal data annealing schedule usedData annealing as an alternative to connector pre-training evaluated——ChatML core128K-token vocabulary used—
Laguna-S-2.1 core—High-recall web-data curation usedStreaming training-data ingestion with prefetched shared-memory batches used—Conservative model-based noise filtering coreMulti-dimensional document quality scoring coreQuality-bucket sampling coreRanking retained documents by continuous contribution score coreDense annotation of ambiguous low-quality data usedPCA-based dimension selection for decorrelated quality signals usedPropella multi-property document annotation usedTwo-axis document-quality labeling by noise and information usedOne-task-per-repository diversity filtering optional—Snapshot-level fuzzy deduplication used—Dynamic multi-agent synthetic-data generation loop coreModular synthetic-data pipeline composition coreBehavioral-constraint augmentation with synthetic system messages usedLarge-scale targeted synthetic data rephrasing usedMatch synthetic-pipeline complexity to teacher capability usedMetadata-conditioned synthetic generation usedMulti-stage synthetic-data generation cascade usedSynthetic data augmentation of organic pre-training data usedTraining-task generation from real commit history usedTwo-sided test validation for synthetic coding tasks used—AutoMixer coreBlind pairwise bucket-boundary calibration usedKL-regularized data-mixture optimization usedPrior-constrained Dirichlet mixture exploration usedRL task sampling proportional to unsolved rate used—Sequence packing used—Subtoken-averaged special-token embedding initialization used—
LingBot-VLA 2.0 coreRobot data feature mapping core—Real-world robot-data pre-training coreLarge-scale multi-source pre-training data curation used—Dataset normalization statistics computation coreHuman verification of robot state and video alignment coreMasking fully missing depth patches coreMinimum valid-frame coverage filtering coreNear-static episode filtering coreProbabilistic masking of partially valid depth patches coreRandom sampling of fully valid depth tokens coreRobotic trajectory quality filtering pipeline coreTrajectory smoothness filtering using jerk and derivative Z-scores coreTrajectory-level quality control coreVision-language-model filtering of egocentric videos coreAutomated anomaly screening usedHuman review of filtered demonstration episodes usedLeft-right consistency checking for stereo pseudo-depth used——Automated vision-language-model annotation of manipulation videos coreVLM-based temporal subtask segmentation and instruction generation coreGaussian-noise augmentation of depth maps usedGenerate pseudo-depth labels from stereo infrared pairs usedSimulate real active RGB-D camera imaging to generate imperfect depth usedSynthetic RGB-D data generation using self-hosted 3D assets used————
MiMo-V2.5 used——Multi-dimensional data filtering used———Three-stage data mixture strategy used———
MiMo-V2.5-Pro used——Multi-dimensional data filtering used———Three-stage data mixture strategy used———
MiMo-V2.6-Pro core————Automated large-scale data synthesis and environment construction usedMulti-agent synthesis of local software mocks for reproducible environments usedTraining SFT teachers on synthetic demonstrations for open-domain tasks used—Sample Mixer coreAgent-centric multimodal data mixture usedData Scheduler usedDynamic sampling for mixed-task reinforcement learning usedSmooth weighted round-robin source scheduling used—Group-local sequence packing used——
MiniMax-M3 used—————Interleaved mixed-modality training usedInterleaved multimodal data used———
Mistral-Large-4 core—Internal offline web mentioned—Quality checks for generated instances used——Agent-based synthetic-data generation pipeline coreMinimal-tool autonomous task authoring usedRefine software tasks using multiple solvers and trajectory inspection usedReuse successful authoring-agent trajectories as midtraining data usedSeed terminal-agent tasks with technical content from pretraining data usedTaxonomy-guided generation of simulated workplace environments usedTwo-stage GitHub-derived software task generation and RL refinement used—Heterogeneous training mixture coreCurriculum-driven data loading used—Sequence packing used—Trie-based tokenization used—
MolmoAct 2 core—Evenly spaced video-frame sampling usedSeparate collection of atomic motion primitives used—Low-frame-rate video sampling with an eight-frame cap coreExcluding evaluation-style datasets usedFiltering no-op actions and unsuccessful demonstrations usedFour-stage quality filtering for community SO-100/101 robot data usedIdle-frame filtering usedLicense and codebase eligibility filtering usedNormalize task strings into natural-language instructions usedStructural validation of robot dataset samples usedTOPReward dataset quality gate usedTOPReward-based dataset quality filtering used——Demonstration collection with alternative language-conditioned motion paths usedRandomize requested instruction length during VLM relabeling usedVLM-based point annotation for visual traces usedVLM-based robot demonstration language re-annotation used—Mixed training on action-only and depth-and-action examples corePre-training on action reasoning, auxiliary robot, and multimodal web data coreWeighted sampling by assigned mixture rates coreCo-training vision-language-action models with multimodal web data usedEpisode-level camera-order randomization usedHeterogeneous embodiment-specific action representations for tokenizer training usedJoint multi-task training usedJoint refinement on embodied and general multimodal data usedMulti-task batch mixing usedPaired side-and-wrist camera-view examples usedTransparent tokenizer training mixture usedUniform sampling of action, depth, and joint depth-and-action tasks usedWithin-batch mixing of training sources used—Dynamic-programming selection for sequence packing usedFixed-cap action-chunk packing usedOn-the-fly sequence packing with attention masking usedQuantized sequence packing usedRobot-example packing with per-example VLM context used—Quantile normalization of robot actions coreRobot-specific token interface coreSimilarity-preserving monotonic assignment of BPE symbols to action bins coreDCT-BPE action compression usedMolmoAct2-FAST Tokenizer usedNormalization and 256-bin discretization of continuous robot states usedNormalize, pad, and tokenize continuous robot actions usedPadding tokenizer and language-model head to a multiple of 512 usedSelectable robot-output styles optional—
NVIDIA-Nemotron-3.5-Lightning-30B-A3B used—GitHub Crawl used—Automated quality filtering of synthetic vision data usedBenchmark decontamination usedBenchmark decontamination and secret removal from training sources usedDifficulty filtering for tool-dependent training examples usedHeuristic filtering usedKeyword- and regex-based content filtering usedMinimum-length filtering for reasoning SFT data usedN-gram repetition filtering usedN-gram verbatim-overlap detection usedNormalize training samples to their problem statements usedOutcome- and execution-based filtering of agentic trajectories usedPer-question retrieval of contamination candidates usedPermissive-license filtering usedReference-answer compatibility auditing usedSeverity-thresholded benchmark contamination removal usedStructural checks for malformed examples usedTranslation quality-score threshold filtering usedUnified data filtering pipeline used—Corpus deduplication usedExact question–answer deduplication used—Agentic visual tool use for image operations usedBodhan-MT translation with Gemma-4 quality assessment and language-specific thresholds usedChunked synthetic long-context translation data usedConcurrent scheduling of translation and quality checks usedCoverage-audit-driven agentic question generation usedDocument-grounded synthetic question generation with answerability verification usedFour-stage Indic synthetic-data generation pipeline usedKnowledge distillation for synthetic data generation usedLarge-scale synthetic data generation, filtering, and curation usedOverlapping windows for longer Santali documents usedRewrite low-scoring translations using source text and identified errors, then recheck usedScore translations against their source for quality usedStep-structured, visually grounded reasoning traces usedSynthetic graph-structured long-context reasoning data usedSynthetic Indic training-data generation by translating curated English documents usedSynthetic privacy-preserving personas usedSynthetic transduction-task training for long translation usedTranslate each selected source document in full without splitting usedCounterfactual data augmentation mentioned—Curated internal-data mixture for vision tool-use training usedDifficulty-based routing of validated questions to SFT or RL usedIndic continued-pretraining data allocation usedPreserve natural training-data format usedReasoning-focused RL curriculum usedStage-specific domain weighting by distillation learning curves usedFixed-budget Indic mixture-ratio ablations evaluatedMix supervised fine-tuning data with teacher-generated reinforcement-learning rollouts evaluated———
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B used——Automated quality filtering of synthetic vision data usedBenchmark decontamination usedBenchmark decontamination and secret removal from training sources usedDifficulty filtering for tool-dependent training examples usedHeuristic filtering usedMinimum-length filtering for reasoning SFT data usedN-gram verbatim-overlap detection usedNormalize training samples to their problem statements usedOutcome- and execution-based filtering of agentic trajectories usedPer-question retrieval of contamination candidates usedPermissive-license filtering usedReference-answer compatibility auditing usedSeverity-thresholded benchmark contamination removal usedSynthetic trajectory filtering for correctness, repetition, and validity usedTranslation quality-score threshold filtering used—Corpus deduplication usedExact question–answer deduplication used—Agentic visual tool use for image operations usedBodhan-MT translation with Gemma-4 quality assessment and language-specific thresholds usedChunked synthetic long-context translation data usedConcurrent scheduling of translation and quality checks usedCoverage-audit-driven agentic question generation usedDocument-grounded synthetic question generation with answerability verification usedFiltering synthetic trajectories for correctness and validity usedFour-stage Indic synthetic-data generation pipeline usedOverlapping windows for longer Santali documents usedRewrite low-scoring translations using source text and identified errors, then recheck usedScore translations against their source for quality usedStep-structured, visually grounded reasoning traces usedSynthetic data generation with NeMo Data Designer usedSynthetic graph-structured long-context reasoning data usedSynthetic Indic training-data generation by translating curated English documents usedSynthetic transduction-task training for long translation usedTranslate each selected source document in full without splitting used—Curated internal-data mixture for vision tool-use training usedDifficulty-based routing of validated questions to SFT or RL usedIndic continued-pretraining data allocation usedPreserve natural training-data format usedReasoning-focused RL curriculum usedStage-specific domain weighting by distillation learning curves usedFixed-budget Indic mixture-ratio ablations evaluatedMix supervised fine-tuning data with teacher-generated reinforcement-learning rollouts evaluated—Packed-sequence training for long contexts used——
OpenVLA / OpenVLA-OFT core—Pre-training on Open X-Embodiment data used—Robot dataset filtering by camera view and control type coreFiltering no-op actions and unsuccessful demonstrations usedFirst-transition removal from demonstrations usedSimulation replay filtering of demonstrations used———Open X-Embodiment dataset mixture coreDropping a poorly fitting dataset from the training mixture usedOcto dataset-mixture weighting used——Per-dimension 256-bin robot-action discretization coreQuantile-bounded action discretization coreReusing least-used tokenizer vocabulary entries for action tokens core—
Qwen3.5-397B-A17B used—————Three-stage pre-training curriculum used——Byte-level byte-pair encoding used—
Qwen3.6-35B-A3B optional—Multimodal processor video-sampling parameters optional———————
SmolVLA core—Pre-training on community-contributed robotics datasets coreCommunity-driven data used—Community robotics dataset filtering by metadata and quality usedJoint-space similarity filtering of observations usedManual camera-viewpoint normalization usedManual review of candidate robotics datasets usedRobotics dataset selection by frame count, visual quality, and task coverage used——Frame-and-instruction prompting for automatic task annotation usedRewrite task instructions under 30 characters beginning with an action verb usedStandardized action-oriented task descriptions from frames and labels used—Multi-task training used—Fixed-shape batching with excess-frame truncation used——
VLA Foundry (Foundry-VLA-1.7B) corePast/future action-window sampling coreStandardized robotics data conversion core—Conversion to WebDataset tar shards coreResampling training data used—Normalize and concatenate configured proprioceptive fields usedEpisode-boundary padding threshold filtering optional———Dataloader-time dataset mixing coreProbabilistic multi-modal dataset mixing coreWeighted dataset-proportion mixing coreWeighted multi-dataset mixing coreMulti-task training on real and simulated robotics data defaultTraining on simulated and real-world manipulation data usedExplicitly weighted batch balancing across datasets optional—Per-modality preprocessing into WebDataset tar shards coreMulti-stage robotics data preprocessing usedConfigurable sequence padding optional——
X-VLA core—DAgger-style data collection used—Privacy-sensitive content filtering and bias mitigation mentioned———Cross-domain and cross-trajectory shuffling coreWeighted sampling of heterogeneous datasets core———
Xiaomi-Robotics-1 core——Filtering idle trajectory segments used——Automated language annotation of manipulation trajectories coreCross-validated consensus annotation for visual grounding usedLanguage annotation of human-segmented post-training clips usedPre-trained VLM relabeling to refine VQA and caption annotations usedVLM-generated embodied reasoning and planning data from robot trajectories used—1:6 vision-language-to-robot-trajectory sampling usedJoint training on robot trajectories and vision-language data usedJoint vision-language and action training used—Vision-language token sequence packing used——
gpt-oss-120b used——CBRN safety filtering of pre-training data used———Text-only pre-training corpus focused on STEM, coding, and general knowledge usedProtocolQA-aligned RL training datasets evaluated——o200k_harmony tokenizer usedo200k_harmony vocabulary used—
π0.5 core—Web-data training used—Filtering idle all-zero-action timesteps usedIdle-data filtering usedPer-dataset action-dimension quantile normalization usedRandom image crop, resize, rotation, and color-jitter augmentation usedSuccess-only episode filtering used——Expert-provided language demonstrations of high-level subtasks used—Heterogeneous-data co-training corePre-training on diverse robot-manipulation data coreCo-training on robot demonstrations and multimodal data usedCross-embodied robot data mixture usedCross-embodiment robot training usedDown-weighting overrepresented task–robot combinations usedLarge-scale multi-source robot-manipulation pre-training mixture usedMultimodal web-data co-training usedRandom camera-view selection during DROID training usedRandom selection among language annotations during DROID training usedTraining on subtask-prediction data usedUniversal action tokenizer with multiple action-space parameterizations used——Byte-pair encoding (BPE) for action-token compression coreDiscrete cosine transform (DCT) action compression coreFAST action tokenizer coreFAST+ coreScale-and-round quantization of DCT coefficients core256-bin proprioceptive-state discretization usedColumn-first DCT-coefficient flattening usedPadding actions to 32 dimensions usedQuantile normalization of robot actions usedFAST action-token training evaluatedPer-dimension 256-bin robot-action discretization not used—

Proposed children

Paths the corpus wanted and the taxonomy does not have. A human promotes them into the outline; the extraction cannot.

robotics action and state normalizationaction normalization, proprioceptive-state normalization, percentile normalizati
↑