Open Models Almanac
Methodsinference & servingreasoning control

general family · filed under inference & serving

Reasoning token-budget control

Reasoning computation is constrained or allocated through a token budget, including inference-time and per-problem controls.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See reasoning control for the methods filed beside it.

Also called Configurable reasoning token budget, given a token budget, inference-time budget control, Inference-time reasoning budget control, per-problem budget control mechanism.

sources
7
models
4
labs adopt it
2
strongest
used

Documented in

Evidence

8 quotes from 7 sources, one card per model, each opening with its strongest.

How sources treat it
optional 6used 2

the Nemotron 3 models are trained to work with inference-time budget control

usedinference servingin Nemotron 3 familyNVIDIA
1 more from this model

The regular and medium-effort reasoning modes have the option to be used in conjunction with inference-time budget control.

optionalinference servingin Nemotron 3.5 SuperNVIDIA

Kimi K3

Moonshot AIadopted1 source

To fine-tune reasoning effort while maximizing token efficiency, we implement a per-problem budget control mechanism during RL

usedunclearin Kimi K3Moonshot AI

The regular and medium-effort reasoning modes have the option to be used in conjunction with inference-time budget control.

optionalinference servingin Nemotron 3.5 SuperNVIDIA
2 more from this model

as well as inference-time reasoning-budget control

optionalinference servingin Nemotron 3.5 SuperNVIDIA

can be turned off or given a token budget

optionalinference servingin Nemotron 3.5 Super VLNVIDIA

NVIDIA-Nemotron-3-Ultra-550B-A55B

NVIDIAadopted2 sources

The regular and medium-effort reasoning modes have the option to be used in conjunction with inference-time budget control.

optionalunclearin Nemotron 3 UltraNVIDIA
2 more from this model

The regular and medium-effort reasoning modes have the option to be used in conjunction with inference-time budget control.

optionalinference servingin Nemotron 3 UltraNVIDIA

Supports inference time reasoning budget control.

optionalinference servingin Nemotron 3 UltraNVIDIA
↑