Open Models Almanac
Methodspost-trainingmid-training & continual pretraining

specific method · filed under post-training

Indic continued pretraining

A continued-pretraining stage that augments a model with additional training on Indic languages.1 It combines synthetic text generated by translating English documents into Indic languages with natural Indic corpora, to strengthen Indian-language capabilities where natural text is scarce.2

Trade-off It improves Indian-language benchmarks by up to 9.82 percentage points.3

How this definition was written

Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.

  1. We augment Nemotron 3.5 Super with an Indic continued-pretraining stage — NVIDIA Nemotron 3.5 Super and Lightning Technical Report
  2. combines synthetic text generated from English documents with natural Indic corpora to strengthen Indian-language capabilities — NVIDIA Nemotron 3.5 Super and Lightning Technical Report
  3. Indic continued pretraining improves Indian-language benchmarks by up to 9.82 percentage points — NVIDIA Nemotron 3.5 Super and Lightning Technical Report

Also called Indic-language continued pre-training, Indic continued pre-training, Indic-language continued pretraining, Indic continued-pretraining stage.

sources
4
models
2
lab adopt it
1
strongest
used

Documented in

Evidence

4 quotes from 4 sources, one card per model, each opening with its strongest.

How sources treat it
used 4

A 100-billion-token stage includes synthetic and natural Indic data spanning 22 Indian languages and 34 language-script configurations.

useddata curationin Nemotron 3.5 SuperNVIDIA
3 more from this model

combines synthetic text generated from English documents with natural Indic corpora to strengthen Indian-language capabilities

useddata curationin Nemotron 3.5 SuperNVIDIA

The model undergoes 100B tokens of Indic continued pre-training

useddata curationin Nemotron 3.5 Super VLNVIDIA

100B tokens of Indic continued pre-training

usedtraining objectivein Nemotron 3.5 Super VLNVIDIA
↑