Open Models Almanac
Methodssoftware implementationkernel & quantization library

implementation detail · filed under software implementation

FlashInfer

A GPU-kernel and inference library used as a backend, including for Mamba operations in the supplied evidence.

The sources on this page name it without explaining how it works. The line above is the extraction's one-line gloss. See kernel & quantization library for the methods filed beside it.

sources
2
model
1
lab adopt it
1
strongest
used

Documented in

Evidence

2 quotes from 2 sources, one card per model, each opening with its strongest.

How sources treat it
optional 1used 1

Further reading

Picked by hand, not extracted: where to read more, not evidence for anything on this page.

↑