specific method · filed under post-training
Indic continued pretraining
A continued-pretraining stage that augments a model with additional training on Indic languages.1 It combines synthetic text generated by translating English documents into Indic languages with natural Indic corpora, to strengthen Indian-language capabilities where natural text is scarce.2
Trade-off It improves Indian-language benchmarks by up to 9.82 percentage points.3
How this definition was written
Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.
We augment Nemotron 3.5 Super with an Indic continued-pretraining stage
— NVIDIA Nemotron 3.5 Super and Lightning Technical Reportcombines synthetic text generated from English documents with natural Indic corpora to strengthen Indian-language capabilities
— NVIDIA Nemotron 3.5 Super and Lightning Technical ReportIndic continued pretraining improves Indian-language benchmarks by up to 9.82 percentage points
— NVIDIA Nemotron 3.5 Super and Lightning Technical Report
Also called Indic-language continued pre-training, Indic continued pre-training, Indic-language continued pretraining, Indic continued-pretraining stage.