single mention · evaluation
Sampled pass@1
Estimates pass@1 from sampled generations, with the evidence specifying 32 generations per prompt.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See averaging - mean@k; avg@k; pass@k; pass^k for the methods filed beside it.
Filed under evaluation › averaging - mean@k; avg@k; pass@k; pass^k