single mention · software implementation
Mooncake
Disaggregates inference by separating prefill and decode across different node pools.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See infrastructure service for the methods filed beside it.
Filed under software implementation › infrastructure service