Gemma 4 31B
Google DeepMindRaw audio is segmented into 40ms chunks at 16kHz, resulting in 640-dimensional vectors per chunk. These are projected directly into the LLM embedding space.
1 more from this model
We removed the audio encoder entirely and projected the raw audio signal into the same dimensional space as text tokens.