single mention · evaluation
On-policy tie-breaking
On-policy responses are preferred over instruction or preference samples in score ties to mitigate distribution shift.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See judge for the methods filed beside it.
Filed under evaluation › judge