specific method · filed under other
Closed-Model Performance with Refusal Substitution
Compute combined performance for closed models by treating refusals as zero and substituting non-refusal responses.
Also called combined performance using closed models.
- source
- 1
- model
- 1
- labs adopt it
- 0
- strongest
- not used
How sources treat it
One count per evidence span, weakest treatment to strongest.
not used 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
Recommendation: Compute combined performance using closed models where non-refusal responses are substituted, treating refusals as zero.
not usedevaluation onlyin gpt-oss-120b and gpt-oss-20bOpenAI
Filed alongside
Other methods under other.
Removing Git-History Leaks from Benchmark ImagesAgentic WorkflowsAutomating Repetitive Infrastructure WorkCode-Driven AnimationEarly Release with Feedback-Driven IterationGenerated Artifact Validation with Linters and Runtime TestsJoint Optimization of Architecture, Cache Precision, and DeploymentPrompt Addendum Prohibiting Direct Online-Solution UsePrompt Modality OrderingRemoving Pattern-Matching-Based Anti-Cheat ChecksRequest Caching in the Browser ToolReward-Hacking Detection SystemScore-versus-Cost Efficiency ComparisonTraining–Inference ConsistencyUnique Run Identifiers