Gemma 4 31B
Google DeepMindRather than adding more layers or parameters to the model, PLE gives each decoder layer its own small embedding for every token.
3 more from this model
The smaller models incorporate Per-Layer Embeddings (PLE) to maximize parameter efficiency in on-device deployments. Rather than adding more layers or parameters to the model, PLE gives each decoder layer its own small embedding for every token.
E2B and E4B use per-layer embeddings as in Gemma 3n [Gemma Team, 2025b], making them 2.3B and 4.5B effective out of 5B and 8B total parameters respectively.
PLE gives each decoder layer its own small embedding for every token.