Open Models Almanac
Methodspost-trainingmid-training & continual pretraining

single mention · post-training

Continued pretraining with natural and synthetic data

Continued pretraining combining high-quality natural and synthetic data, without evidence limiting it to a particular language domain.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See mid-training & continual pretraining for the methods filed beside it.

Filed under post-training › mid-training & continual pretraining