Gemma 4 31B
Google DeepMindWe’re releasing Multi-Token Prediction (MTP) drafters for the Gemma 4 family. By using a specialized speculative decoding architecture, these drafters deliver up to a 3x speedup without any degradation in output quality or reasoning logic.
2 more from this model
We train a small autoregressive MTP drafter head with our models, used for speculative decoding.
Gemma 4 12B comes equipped with Multi-Token Prediction (MTP) drafters to reduce latency.