single mention · inference & serving
Semi-autoregressive draft generation
The sources on this page only mention it in passing. See decoding strategy for the methods filed beside it.
Filed under inference & serving › decoding strategy
single mention · inference & serving
The sources on this page only mention it in passing. See decoding strategy for the methods filed beside it.
Filed under inference & serving › decoding strategy