Open Models Almanac
Methodsmodel architecturepositional encoding

single mention · model architecture

RoPE scaling for context extension (YaRN)

The sources on this page name it without explaining how it works. See positional encoding for the methods filed beside it.

Also called RoPE scaling techniques.

Filed under model architecture › positional encoding