specific method · filed under model architecture
Dense model architecture
A dense model architecture, distinguished in the evidence from a MoE model by its emphasis on maximizing raw quality and serving as a fine-tuning foundation.
Also called 31B Dense.
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
used 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
while our 31B Dense is maximizing raw quality and provides a powerful foundation for fine-tuning
usedmodel architecturein Gemma 4 31BGoogle
Filed alongside
Other methods under model architecture.