single mention · inference & serving
Generation-prefix mode selection
A chat template selects thinking or instruct generation by placing the corresponding channel in the generation prefix.
The sources on this page name it without explaining how it works. The line above is the extraction's one-line gloss. See reasoning control for the methods filed beside it.
Also called channels.
Filed under inference & serving › reasoning control