Open Models Almanac
Methodsevaluationjudge

methods · evaluation

judge

30 methods filed at this node or below it, from the sources of 13 models.

In this branch 30

Everything filed at this node or below it, with one collapsible heading per child node.

filed here 30

LLM-as-a-Judge used · 2 sources · 2 quotes
29 single mentions
Agent-as-a-Judge used · 1 source · 2 quotes
Agent-as-a-Verifier used · 1 source · 1 quote
Agentic judge protocol used · 1 source · 1 quote
Claude Opus 4.6 judge used · 1 source · 1 quote
Deterministic tool-call verifier used · 1 source · 1 quote
Frozen judge model used · 1 source · 1 quote
GPT-5.5 (medium) judge used · 1 source · 1 quote
Human-calibrated LLM-as-a-judge used · 1 source · 1 quote
JSON-escaped input formatting for judge used · 1 source · 1 quote
Judge-LLM ensemble scoring used · 1 source · 2 quotes
Large reasoning model as evaluator used · 1 source · 1 quote
LLM autograding with expert validation used · 1 source · 1 quote
LLM judge for conversation classification used · 1 source · 1 quote
LLM judge for document-quality annotation used · 1 source · 1 quote
LLM-as-a-Verifier used · 1 source · 1 quote
LLM-based correctness judging used · 1 source · 1 quote
LLM-based external API usage inspection used · 1 source · 1 quote
Official task verifier scoring used · 1 source · 1 quote
On-policy tie-breaking used · 1 source · 1 quote
Order-swapped verifier evaluation used · 1 source · 1 quote
Probabilistic Pivot Tournament used · 1 source · 1 quote
Reward-hack judge used · 1 source · 1 quote
Rule-based anti-cheat checks used · 1 source · 1 quote
Three-criterion trajectory verification used · 1 source · 1 quote

By model

Which of this branch's methods each model's own documents describe, and how strongly. Under each model: its strongest treatment anywhere in the branch.

Modelmethods
GLM-5.3 usedLLM-as-a-Judge usedLLM-based external API usage inspection usedOfficial task verifier scoring usedRule-based anti-cheat checks used—
NVIDIA-Nemotron-3-Ultra-550B-A55B usedDeterministic tool-call verifier usedLLM-based correctness judging used—
Alpamayo 1.5 / 2 Super usedLarge reasoning model as evaluator used—
GLM-5.2 usedAgent-as-a-Judge usedGPT-5.5 (medium) judge used—
GR00T N1.7 usedMultimodal LLM instruction-adherence judging used—
Kimi K3 usedAgentic judge protocol used—
Kolibri-1 usedFrozen judge model usedLLM judge for conversation classification usedLLM judge for document-quality annotation usedSchema-constrained decoding for judge outputs used—
LFM3-1.7B usedJudge-LLM ensemble scoring usedOn-policy tie-breaking used—
Laguna-S-2.1 usedDecompositional instruction-following judge usedHuman-calibrated LLM-as-a-judge usedReward-hack judge used—
MiniMax-M3 usedAgent-as-a-Verifier usedLLM-as-a-Judge used—
NVIDIA-Nemotron-3.5-Lightning-30B-A3B usedClaude Opus 4.6 judge usedJSON-escaped input formatting for judge usedLLM-as-a-Verifier usedLLM-judge verification of contamination pairs usedOrder-swapped verifier evaluation usedProbabilistic Pivot Tournament usedTeacher-based text-only equivalence judging usedThree-criterion trajectory verification used—
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B usedClaude Opus 4.6 judge usedJSON-escaped input formatting for judge usedLLM-as-a-Verifier usedLLM-judge verification of contamination pairs usedOrder-swapped verifier evaluation usedProbabilistic Pivot Tournament usedTeacher-based text-only equivalence judging usedThree-criterion trajectory verification used—
gpt-oss-120b usedLLM autograding with expert validation used—
↑