Gemma 4 31B
Google DeepMindTo optimize memory for long contexts, global layers feature unified Keys and Values, and apply Proportional RoPE (p-RoPE).
1 more from this model
global layers feature unified Keys and Values, and apply Proportional RoPE (p-RoPE).