Model techniques map
Techniquesevaluationjudge

specific method · filed under evaluation

Reward-hack detection judge

A post-hoc judge detects reward-hacking strategies in model evaluation runs.

Also called Reward hack judge.

source
1
model
1
lab adopt it
1
strongest
used

How sources treat it

One count per evidence span, weakest treatment to strongest.

used 1

Documented in

Evidence

1 span quoted from the sources, strongest treatment first.

we have developed a reward hack judge to detect these specific cheating strategies, which we ran post-hoc-on all candidate evaluation runs for this report.

usedevaluation only

Filed alongside

Other methods under evaluation :: judge.