MiMo-V2.5
Xiaomifull-attention
general family · filed under model architecture
Attention over the full context, contrasted with restricted or hybrid attention patterns.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See global attention for the methods filed beside it.
2 quotes from 2 sources, one card per model, each opening with its strongest.
full-attention
MSA matched full attention on the vast majority of capabilities