specific method · filed under post-training
Safety training to an internal specification
Training a model to follow an internal specification of safe behavior across modalities.
Also called Safety training to internal spec.
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
used 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
We trained Inkling to an internal spec of safe model behavior across all modalities.
usedpost trainingin InklingThinking Machines Lab
Filed alongside
Other methods under post-training :: supervised fine-tuning.
Supervised fine-tuningFine-tuningLight SFT on teacher-distribution dataLoRA fine-tuningRejection samplingSelf-correction cold startSFT bootstrapping with synthetic dataAdversarial fine-tuningAutoregressive fine-tuningCold-started SFT modelEvaluation-based early stoppingFine-tuning with demographically balanced datasetsFrozen-network warmup for new special tokensInstruction hierarchy trainingInstruction-following fine-tuningLightweight speaker fine-tuningPrompt-based cold start for tool useReasoning-data system promptSFT checkpoint for RL researchSFT on MiMo-generated task dataSpecialist-model trainingSupervised fine-tuning at 256k sequence lengthToken-budget-based SFT data blending