Mistral-Large-4
Mistral AIMistral uses LeRope, a YaRN-scaled RoPE with one learned multiplier per frequency.
coremodel architecturein Mistral Large 4Mistral AI
1 more from this model
LeRoPE and SSMax let the model learn rotary frequencies and per-head query scaling.
usedmodel architecturein Mistral Large 4Mistral AI