Open Models Almanac
Methodsmodel architecturechannel mixermixture of expertsexpert routing

implementation detail · filed under model architecture

Top-k expert routing

The sources on this page only mention it in passing. See expert routing for the methods filed beside it.

sources
11
models
8
labs adopt it
7
strongest
core

Documented in

Tencent (Hunyuan)
Aleph Alpha
Mistral AI
Thinking Machines Lab
Z.ai (Zhipu AI)
MiniMax
Xiaomi

Evidence

12 quotes from 11 sources, one card per model, each opening with its strongest.

How sources treat it
used 4core 8

Hy3

Tencent (Hunyuan)adopted2 sources

Number of Experts | 192 experts, top-8 activated

coremodel architecturein Hy3Tencent Hy Team
1 more from this model

Hy3’s architecture contains a sparse MoE with 192 experts and top-8 routing.

usedmodel architecturein Hy3Tencent
↑