Open Models Almanac
Methodsmodel architecturepositional encoding

single mention · model architecture

2D coordinate-based positional embeddings

These embeddings add 2D coordinate information directly to patch representations, distinct from rotary encodings.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See positional encoding for the methods filed beside it.

Filed under model architecture › positional encoding