general family · filed under inference & serving
Standalone parallel speculative drafters
Standalone parallel speculative drafters are separate draft models trained to generate speculative tokens for a main model during decoding.1 They complement the native MTP head and are released as separately trained checkpoints for parallel speculative decoding.2
How this definition was written
Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.
we release LiLiCorr (Rusanovsky et al., 2026), a standalone drafter for Nemotron 3.5 Super that targets low-concurrency serving, where decoding is strongly memory-bandwidth bound
— NVIDIA Nemotron 3.5 Super and Lightning Technical ReportThis release builds on our earlier parallel-drafter work for Nemotron 3.5 Lightning, for which we trained and released separate DFlash (Chen et al., 2026a) and DSpark (Cheng et al., 2026) checkpoints
— NVIDIA Nemotron 3.5 Super and Lightning Technical Report
Also called Parallel speculative drafters, parallel drafters, standalone parallel drafters.