taxonomy node · level 2
serving parallelism
17 methods filed at this node or below it, from the sources of 15 models.
inference & serving :: serving parallelism
Matching aids for the classifier: serving-time expert parallelism; data-parallel attention; prefill-decode disaggregation; DeepEP; all-to-all communication; low-precision MoE combine.
In this branch 17
Everything filed at this node or below it, with one collapsible heading per child node.
filed here 17
By model
Which of this branch's techniques each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.