Open Models Almanac
Methodsmodel architecturetoken mixerlinear attention & state spaceMamba

single mention · model architecture

Mamba checkpointing

A Mamba-related inference checkpointing technique mentioned alongside caching and decoding optimizations; its mechanism is not specified.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See Mamba for the methods filed beside it.

Also called Mamba checkpointing for inference.

Filed under model architecture › token mixer › linear attention & state space › Mamba