Open Models Almanac
Methods

single mention · not yet filed

One global-attention layer per four-layer GDN hybrid block

The sources on this page only mention it in passing.