single mention · inference & serving
Probabilistic draft sampling
Samples each LiLiCorr draft slot from its candidate distribution at the request’s temperature.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See decoding strategy for the methods filed beside it.
Filed under inference & serving › decoding strategy