single mention · software implementation
vLLM language-model-only serving mode
A vLLM serving mode that skips the vision encoder and serves only the language model.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See inference engine for the methods filed beside it.
Also called --language-model-only.
Filed under software implementation › inference engine