single mention · inference & serving
Fused reduce-scatter/all-gather collectives
Uses fused reduce-scatter and all-gather collectives, described as built on FlashInfer's Lamport-protocol all-reduce.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See serving parallelism for the methods filed beside it.
Filed under inference & serving › serving parallelism