Open Models Almanac
Methodsevaluationaveraging - mean@k; avg@k; pass@k; pass^k

single mention · evaluation

Sampled pass@1

Estimates pass@1 from sampled generations, with the evidence specifying 32 generations per prompt.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See averaging - mean@k; avg@k; pass@k; pass^k for the methods filed beside it.

Filed under evaluation › averaging - mean@k; avg@k; pass@k; pass^k