Open Models Almanac
Methodsmodel architecturechannel mixermixture of expertsfine-grained experts

methods · mixture of experts

fine-grained experts

8 methods filed at this node or below it, from the sources of 4 models.

In this branch 8

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 8

Expert granularity evaluated · 3 sources · 3 quotes
7 single mentions
Fine-grained expert segmentation core · 1 source · 1 quote
Many small experts used · 1 source · 1 quote
MoE granularity 4 used · 1 source · 1 quote
Coarse-grained MoE configuration evaluated · 1 source · 1 quote
Fine-grained MoE configuration evaluated · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

↑