single mention · inference & serving
Per-SM accumulation buffers with deterministic global summation
Accumulates into separate buffers for each SM and then deterministically sums the buffers globally.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See inference kernel for the methods filed beside it.
Filed under inference & serving › inference kernel