Open Models Almanac
Methodsmodel architecturechannel mixermixture of expertsexpert routing

single mention · model architecture

Keep Routing

Preserves sampled inference routing paths and enforces the same expert paths during training.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See expert routing for the methods filed beside it.

Filed under model architecture › channel mixer › mixture of experts › expert routing