employing a Mixture-of-Experts hybrid Mamba-Attention architecture
coremodel architecturein Nemotron 3 UltraNVIDIA
3 more from this model
Nemotron 3 Ultra uses a MoE Hybrid Mamba-Attention architecture
coremodel architecturein Nemotron 3 UltraNVIDIA
Employs Mixture-of-Experts Hybrid Mamba-Attention architecture.
coremodel architecturein Nemotron 3 UltraNVIDIA
Mixture-of-Experts hybrid Mamba-Attention language model
coremodel architecturein Nemotron 3 UltraNVIDIA