methods · post-training
mid-training & continual pretraining
18 methods filed at this node or below it, from the sources of 17 models.
Explainer · D4 · 25 minMultimodal training data: when pixels and sound enter the recipeImages from the first step train both modalities together, at a cost in text tokens; images added later keep a finished text model, which then has to be protectedExplainer · S2 · 30 minMid-training and long-context extension: one word for several operationsA stage on a finished base adds skills and context length, the model loses some of what it knew, and both sides are mostly measured through stand-ins
In this branch 18
Everything filed at this node or below it, with one collapsible heading per child node.
filed here 18
12 single mentions
By model
Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.