Open Models Almanac
Methodsinference & serving

single mention · inference & serving

Reusable-cache optimization

An inference optimization that uses reusable caches in an optimized eager execution path.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See inference & serving for the methods filed beside it.

Also called Reusable-cache optimization for inference, reusable-cache optimizations.

Filed under inference & serving