single mention · inference & serving
Inference-time vision-token budget scaling
Reduces the vision token budget at inference time, with the evidence reporting minimal degradation on general vision benchmarks.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See context management for the methods filed beside it.
Also called Reducing the token budget.
Filed under inference & serving › context management