Open Models Almanac
Methodsinference & servinginference kernel

specific method · filed under inference & serving

FlashAttention-3

The third-generation FlashAttention implementation selected as an attention backend.

The sources on this page name it without explaining how it works. The line above is the extraction's one-line gloss. See inference kernel for the methods filed beside it.

Also called --attention-backend fa3, FlashAttention 3 (fa3).

sources
2
model
1
lab adopt it
1
strongest
used
↑