Open Models Almanac
Methodspost-trainingsupervised fine-tuning

methods · post-training

supervised fine-tuning

110 methods filed at this node or below it, from the sources of 29 models.

In this branch 110

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 110

Supervised fine-tuning core · 23 sources · 27 quotes
Low-Rank Adaptation core · 11 sources · 12 quotes
Two-stage supervised fine-tuning core · 4 sources · 5 quotes
Full-model fine-tuning core · 3 sources · 3 quotes
Embodiment-specific fine-tuning core · 2 sources · 3 quotes
German-language reasoning post-training core · 2 sources · 2 quotes
Fine-tuning used · 6 sources · 6 quotes
Assistant-only loss used · 2 sources · 2 quotes
End-to-end fine-tuning used · 2 sources · 2 quotes
Imitation learning used · 2 sources · 2 quotes
Multitask fine-tuning used · 2 sources · 2 quotes
Parameter-efficient fine-tuning used · 2 sources · 2 quotes
Rejection sampling used · 2 sources · 2 quotes
Self-correction cold start used · 2 sources · 2 quotes
SFT bootstrapping with synthetic data used · 2 sources · 2 quotes
Single-GPU fine-tuning optional · 2 sources · 2 quotes
93 from one source, or only mentioned as not used
Depth-token noise during fine-tuning core · 1 source · 1 quote
Frozen Qwen3-VL-4B instruction encoder core · 1 source · 1 quote
Frozen video encoder for camera frames core · 1 source · 1 quote
Optimized Fine-Tuning core · 1 source · 1 quote
Action-focused second-stage training used · 1 source · 1 quote
Adversarial fine-tuning used · 1 source · 1 quote
Cold-started supervised fine-tuning model used · 1 source · 1 quote
Context-grounded abstention training used · 1 source · 1 quote
Embodied specialization stage used · 1 source · 1 quote
Evaluation-based early stopping during SFT used · 1 source · 1 quote
Fine-tuning on downstream robot tasks used · 1 source · 1 quote
Fine-tuning with high-quality data used · 1 source · 1 quote
Frozen-backbone action-expert fine-tuning used · 1 source · 1 quote
Instruction hierarchy training used · 1 source · 1 quote
Instruction-following fine-tuning used · 1 source · 1 quote
Joint multimodal supervised fine-tuning used · 1 source · 1 quote
Joint policy adaptation used · 1 source · 1 quote
Lightweight speaker fine-tuning used · 1 source · 1 quote
Mask tool responses from the SFT loss used · 1 source · 1 quote
Post-training on the DROID Dataset used · 1 source · 1 quote
Post-training on the LIBERO Dataset used · 1 source · 1 quote
Rank-32 Low-Rank Adaptation used · 1 source · 1 quote
Reasoning-data system prompt used · 1 source · 1 quote
Robot-only fine-tuning used · 1 source · 1 quote
Single-stage supervised fine-tuning used · 1 source · 1 quote
Specialist training used · 1 source · 1 quote
Token-budget-based SFT data blending used · 1 source · 1 quote
Use 100% SFT data for final QAD used · 1 source · 1 quote
Domain-specific post-training optional · 1 source · 1 quote
Fine-tuning action heads for a new embodiment optional · 1 source · 1 quote
Fine-tuning on traces from Mistral Large 4 optional · 1 source · 1 quote
Frozen-backbone projection-layer adaptation optional · 1 source · 1 quote
Local fine-tuning for specialization optional · 1 source · 1 quote
Action-expert-only fine-tuning evaluated · 1 source · 1 quote
Experimental agentic SFT blend evaluated · 1 source · 1 quote
Fine-tuning on BridgeData V2 only evaluated · 1 source · 1 quote
Freeze the vision encoder during fine-tuning evaluated · 1 source · 2 quotes
Joint fine-tuning across multiple embodiments evaluated · 1 source · 1 quote
Last-layer and token-embedding fine-tuning evaluated · 1 source · 1 quote
Long-context SFT data ablation evaluated · 1 source · 1 quote
Loss masking in supervised fine-tuning evaluated · 1 source · 1 quote
Reasoning-effort assignment in SFT evaluated · 1 source · 1 quote
Sandwich fine-tuning evaluated · 1 source · 1 quote
Shortened supervised fine-tuning ablation recipe evaluated · 1 source · 1 quote
Task-specific fine-tuning of a multitask policy evaluated · 1 source · 1 quote
Heterogeneous Low-Rank Adaptation not used · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

Modelmethods
Hy3 usedSupervised fine-tuning usedFine-tuning optional—
MiMo-V2.6-Flash coreSFT checkpoint intended as an RL starting point coreSelf-correction cold start usedSupervised fine-tuning on MiMo-generated task data used—
NVIDIA-Nemotron-3-Ultra-550B-A55B coreLight supervised fine-tuning on teacher-distribution data coreRejection sampling usedSupervised fine-tuning usedToken-budget-based SFT data blending used—
Alpamayo 1.5 / 2 Super coreSupervised fine-tuning on Chain of Causation data core—
DeepSeek-V3.2 usedPrompt-based cold start for reasoning with tool use usedReasoning-data system prompt used—
DeepSeek-V4-Pro usedSpecialist training usedSupervised fine-tuning used—
FLUX 3 Action coreFrozen Qwen3-VL-4B instruction encoder coreFrozen video encoder for camera frames coreAction-focused second-stage training usedFine-tuning for video-game and simulated-drone control usedRobot-specific fine-tuning with a small demonstration set usedFine-tuning action heads for a new embodiment optional—
GLM-5.2 usedRejection sampling used—
GR00T N1.7 usedFine-tuning video generation models on robot teleoperation data usedFreeze language and visual backbones during fine-tuning usedFreeze the language component of the vision-language backbone usedLow-Rank Adaptation usedPost-training on the Bridge Dataset in SimplerEnv usedPost-training on the DROID Dataset usedPost-training on the Fractal Dataset in SimplerEnv usedPost-training on the LIBERO Dataset usedSingle-embodiment post-training fine-tuning usedFine-tuning on custom embodiments with LeRobot-format datasets optional—
Gemma 4 31B mentionedFine-tuning mentioned—
Inkling coreLow-Rank Adaptation coreSafety training to an internal specification usedSFT bootstrapping with synthetic data used—
Kimi K3 usedSupervised fine-tuning used—
Kolibri-1 coreGerman-language reasoning post-training coreAssistant-only loss usedContext-grounded abstention training usedFine-tuning a specialist model for each dataset cluster usedInclude English and German safety datasets in SFT usedLong-context post-training with document question answering usedMask loss on incorrect tool calls and terminal actions usedMask loss on invalid or repeated tool calls usedSafety refusal training with appropriate partial answers usedSFT refusal training for PII extraction attacks usedSupervised fine-tuning usedLong-context SFT data ablation evaluatedLoss masking in supervised fine-tuning evaluatedReasoning-effort assignment in SFT evaluatedShortened supervised fine-tuning ablation recipe evaluated—
LFM3-1.7B coreSupervised fine-tuning coreCross-category integration of multilingual samples in SFT data usedEnd-to-end fine-tuning usedFine-tuned skill monitor for robot recovery usedJoint multimodal supervised fine-tuning usedRank-32 Low-Rank Adaptation usedTask-specific fine-tuning for wind-turbine blade defect detection usedFrozen-backbone projection-layer adaptation optionalLocal fine-tuning for specialization optionalSingle-GPU fine-tuning optional—
Laguna-S-2.1 usedEvaluation-based early stopping during SFT usedFrozen-network warmup for new special tokens usedInstruction-following fine-tuning usedSFT bootstrapping with synthetic data used—
MiMo-V2.5 usedCold-started supervised fine-tuning model usedSupervised fine-tuning used—
MiMo-V2.5-Pro usedCold-started supervised fine-tuning model usedSupervised fine-tuning used—
MiMo-V2.6-Pro coreSFT checkpoint intended as an RL starting point coreSelf-correction cold start usedSupervised fine-tuning on MiMo-generated task data used—
Mistral-Large-4 usedAssistant-only loss usedFreeze the vision encoder during pretraining and unfreeze for SFT usedLow-Rank Adaptation usedSupervised fine-tuning usedFine-tuning optionalFine-tuning on traces from Mistral Large 4 optional—
MolmoAct 2 coreDepth-token noise during fine-tuning coreEmbodiment-specific fine-tuning coreFull-model fine-tuning coreEmbodied specialization stage usedFine-tuning on target-embodiment demonstrations usedFine-tuning on the combined LIBERO training suites usedLow-Rank Adaptation usedRobot-only fine-tuning usedSeparate single-task policies for bimanual YAM tasks usedFine-tuning for a target robot embodiment or benchmark optionalAction-expert-only fine-tuning evaluatedFlow-loss updates through action-expert conditioning not usedFreeze added-token input embeddings during embodiment fine-tuning not used—
NVIDIA-Nemotron-3.5-Lightning-30B-A3B usedCapability-targeted second-stage supervised fine-tuning usedLow-Rank Adaptation usedMask tool responses from the SFT loss usedRandom-budget truncation of reasoning traces usedSingle-stage supervised fine-tuning usedSupervised fine-tuning usedSupervised fine-tuning at 256k sequence length usedTwo-stage supervised fine-tuning usedUse 100% SFT data for final QAD usedExperimental agentic SFT blend evaluatedFine-tuning with demographically balanced datasets mentioned—
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B coreTwo-stage supervised fine-tuning coreCapability-targeted second-stage supervised fine-tuning usedMask tool responses from the SFT loss usedPost-training on organization-specific data usedRandom-budget truncation of reasoning traces usedSingle-stage supervised fine-tuning usedSupervised fine-tuning usedUse 100% SFT data for final QAD usedDomain-specific post-training optionalLow-Rank Adaptation optionalExperimental agentic SFT blend evaluated—
OpenVLA / OpenVLA-OFT coreFine-tuning a vision-language model to predict robot actions coreFine-tuning all model parameters including the vision backbone coreOptimized Fine-Tuning coreVision-encoder fine-tuning during VLA training coreEnd-to-end fine-tuning usedFine-tuning with setup-specific demonstrations usedFull-model fine-tuning usedImitation learning usedLow-Rank Adaptation usedParameter-efficient fine-tuning usedSupervised fine-tuning on target-task demonstrations usedFine-tuning with demonstration data for new tasks and robot setups optionalFine-tuning on BridgeData V2 only evaluatedFreeze the vision encoder during fine-tuning evaluatedLast-layer and token-embedding fine-tuning evaluatedSandwich fine-tuning evaluated—
Qwen3.5-397B-A17B usedLightweight speaker fine-tuning used—
SmolVLA usedFine-tuning usedFrozen-backbone action-expert fine-tuning usedImitation learning usedMultitask fine-tuning used—
VLA Foundry (Foundry-VLA-1.7B) evaluatedTask-specific fine-tuning of a multitask policy evaluated—
X-VLA usedEmbodiment-specific fine-tuning usedJoint policy adaptation usedPeriodic policy training with failure-targeted demonstration collection usedPrompt warm-up with the pretrained backbone frozen usedJoint fine-tuning across multiple embodiments evaluatedLow-Rank Adaptation evaluatedHeterogeneous Low-Rank Adaptation not used—
gpt-oss-120b usedAdversarial fine-tuning usedInstruction hierarchy training usedFine-tuning optional—
π0.5 usedAdaptation of vision-language models using robot data usedFine-tuning on downstream robot tasks usedFine-tuning with high-quality data usedFull-model fine-tuning usedFine-tuning optionalLow-Rank Adaptation optionalTraining a downstream policy only on high-quality task data evaluated—
↑