specific method · filed under inference & serving
NEXTN speculative decoding
A named speculative-decoding mode associated in the evidence with a multi-step-trained MTP head and draft tokens.
Also called native NEXTN speculative decoding, NEXTN speculative decoding algorithm, NEXTN.
- sources
- 4
- models
- 3
- labs adopt it
- 2
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
Documented in
Evidence
4 spans quoted from the sources, strongest treatment first.
--speculative-algorithm NEXTN --speculative-num-steps 3 --speculative-eagle-topk 1 --speculative-num-draft-tokens 4
the model ships a 1-layer MTP head trained with multiple steps, exposed by SGLang as native NEXTN speculative decoding.
--speculative-algo NEXTN --speculative-num-steps 3 --speculative-eagle-topk 1 --speculative-num-draft-tokens 4
--speculative-algo NEXTN --speculative-num-steps 3 --speculative-eagle-topk 1 --speculative-num-draft-tokens 4
Filed alongside
Other methods under inference & serving :: decoding strategy.