Open Models Almanac
Methodssoftware implementationinfrastructure service

single mention · software implementation

NIXL toy proxy

A toy proxy used for routing in prefill/decode disaggregation tests; the evidence distinguishes it from vllm-router.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See infrastructure service for the methods filed beside it.

Filed under software implementation › infrastructure service