Open Models Almanac
Methodsmodel architecturecontext capacity

methods · model architecture

context capacity

14 methods filed at this node or below it, from the sources of 11 models.

In this branch 14

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 14

1M-token context window core · 5 sources · 5 quotes
N-gram embedding lookup memory core · 5 sources · 5 quotes
Engram core · 3 sources · 3 quotes
Host-memory offload for N-gram embeddings used · 3 sources · 3 quotes
Progressive context extension used · 2 sources · 2 quotes
8 single mentions
256K context window core · 1 source · 1 quote
Single-layer N-gram embedding placement core · 1 source · 1 quote
Enabling 1M context in Step Plan optional · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

↑