Open Models Almanac
Methodsmodel architecturecontext capacity

single mention · model architecture

Context-length extrapolation without positional rescaling

Evaluation beyond training context length without applying positional rescaling.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See context capacity for the methods filed beside it.

Also called without positional rescaling.

Filed under model architecture › context capacity