Open Models Almanac
Methodsinference & servinginference kernel

single mention · inference & serving

Per-SM accumulation buffers with deterministic global summation

Accumulates into separate buffers for each SM and then deterministically sums the buffers globally.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See inference kernel for the methods filed beside it.

Filed under inference & serving › inference kernel