taxonomy node · level 4
latent mixture of experts
5 methods filed at this node or below it, from the sources of 3 models.
model architecture :: channel mixer :: mixture of experts :: latent mixture of experts
Matching aids for the classifier: LatentMoE; stable LatentMoE; hybrid latent MoE.
In this branch 5
Everything filed at this node or below it, with one collapsible heading per child node.
By model
Which of this branch's techniques each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.
| Model | techniques |
|---|---|
| NVIDIA-Nemotron-3-Ultra-550B-A55B core | Hybrid Latent Mixture of Experts coreLatentMoE core— |
| Kimi K3 core | LatentMoE coreNormalized LatentMoE coreSharded latent weights with fused all-gather GEMM epilogue core— |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B core | LatentMoE coreLatent-dimension reduction used— |