Open Models Almanac
Methods

single mention · not yet filed

Interleaved Mamba-2, mixture-of-experts, and attention hybrid architecture

The sources on this page only mention it in passing.