Open Models Almanac
Methodsinference & servingdecoding strategy

single mention · inference & serving

Semi-autoregressive drafting with sequential Markov correction

Keeps the drafter body parallel and uses a lightweight sequential head to adjust each slot’s logits based on the previous drafted token.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See decoding strategy for the methods filed beside it.

Also called semi-autoregressive design.

Filed under inference & serving › decoding strategy