Open Models Almanac
Methodsevaluation

single mention · evaluation

Synthetic benchmark-question perturbation evaluation

Evaluates decontamination using benchmark questions transformed by multiple augmentations at graded strengths.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See evaluation for the methods filed beside it.

Also called 13 augmentations, at four strengths.

Filed under evaluation