Open Models Almanac
Methodsmodel architecturechannel mixermixture of experts

specific method · filed under model architecture

Asymmetric input/output parameter activation

A sparse MoE configuration that activates different numbers of parameters for input and output processing.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See mixture of experts for the methods filed beside it.

Also called asymmetric input/output activation split, asymmetric split.

sources
2
models
2
lab adopt it
1
strongest
core

Documented in

Evidence

2 quotes from 2 sources, one card per model, each opening with its strongest.

How sources treat it
core 2
↑