Open Models Almanac
Methodsevaluationaveraging - mean@k; avg@k; pass@k; pass^k

methods · evaluation

averaging - mean@k; avg@k; pass@k; pass^k

5 methods filed at this node or below it, from the sources of 3 models.

In this branch 5

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 5

all mentioned once
4-shot sampled pass@1 used · 1 source · 1 quote
Mean benchmark score used · 1 source · 1 quote
Mean of per-rubric scores used · 1 source · 1 quote
Pass@k used · 1 source · 1 quote
Sampled pass@1 used · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

↑