Model techniques map
Techniquesmodel architecturechannel mixermixture of expertslatent mixture of experts

specific method · filed under model architecture

Hybrid Latent Mixture of Experts

A hybrid latent mixture-of-experts architecture, distinguished in the evidence only by its hybrid designation.

source
1
model
1
lab adopt it
1
strongest
core

How sources treat it

One count per evidence span, weakest treatment to strongest.

core 1

Documented in

Evidence

1 span quoted from the sources, strongest treatment first.

introduce a breakthrough hybrid latent mixture-of-experts (MoE) architecture

coremodel architecturein Nemotron 3 familyNVIDIA

Filed alongside

Other methods under model architecture :: channel mixer :: mixture of experts :: latent mixture of experts.