Open Models Almanac
Methods

single mention · not yet filed

Minimal hybrid of gated short convolution blocks and grouped-query attention

The sources on this page only mention it in passing.

Also called minimal hybrid.