Open Models Almanac
Methodsevaluationaveraging - mean@k; avg@k; pass@k; pass^k

single mention · evaluation

4-shot sampled pass@1

Reports pass@1 from four-shot sampled generation using 32 generations per prompt for MATH-500.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See averaging - mean@k; avg@k; pass@k; pass^k for the methods filed beside it.

Filed under evaluation › averaging - mean@k; avg@k; pass@k; pass^k