Open Models Almanac
Methodsinference & servingserving parallelism

single mention · inference & serving

Fused reduce-scatter/all-gather collectives

Uses fused reduce-scatter and all-gather collectives, described as built on FlashInfer's Lamport-protocol all-reduce.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See serving parallelism for the methods filed beside it.

Filed under inference & serving › serving parallelism