methods · training objective
multi-token prediction objective
7 methods filed at this node or below it, from the sources of 7 models.
In this branch 7
Everything filed at this node or below it, with one collapsible heading per child node.
By model
Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.
| Model | methods |
|---|---|
| NVIDIA-Nemotron-3-Ultra-550B-A55B used | Frozen-backbone MTP-head fine-tuning usedMTP Boosting usedShared-weight MTP objective used— |
| MiMo-V2.5 used | Multi-Token Prediction used— |
| MiMo-V2.5-Pro used | Multi-Token Prediction used— |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B used | Continued pretraining for MTP layers usedLK loss usedMTP Boosting usedMulti-Token Prediction used— |
| NVIDIA-Nemotron-3.5-Super-VL-120B-A12B used | LK loss usedMTP Boosting usedMTP warm-up used— |
| Qwen3.5-397B-A17B used | Multi-Token Prediction used— |
| Qwen3.8-Flash-Next used | Multi-Token Prediction used— |