Open Models Almanac
Methodsmodel architecturepositional encoding

specific method · filed under model architecture

LeRoPE

A learnable rotary-encoding approach in which rotary frequencies are learned; the supplied evidence also associates the name with YaRN scaling and learned frequency multipliers, but does not settle whether these are the same method.

The sources on this page name it without explaining how it works. The line above is the extraction's one-line gloss. See positional encoding for the methods filed beside it.

sources
2
model
1
lab adopt it
1
strongest
core
↑