Techniquesevaluationjudge

general family · filed under evaluation

LLM-as-a-Judge

An LLM is used to score or judge outputs; the evidence does not specify a more particular judging procedure.

source: 1
model: 1
lab adopt it: 1
strongest: used

How sources treat it

One count per evidence span, weakest treatment to strongest.

used 1

Documented in

Further reading

Picked by hand, not extracted: where to read more, not evidence for anything on this page.

Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena (Zheng et al., 2023) paper arxiv.org

Evidence

1 span quoted from the sources, strongest treatment first.

LLM-as-a-Judge scoring

usedevaluation onlyin MiniMax-M3MiniMax

MiniMax M3: Frontier Coding, 1M Context, Native Multimodality — All in One Model - MiniMax Research·MiniMax·2026-05-31

Filed alongside

Other methods under evaluation :: judge.

Agent-as-a-Judge Independent quality-inspection agent Agent-as-a-Verifier Decompositional instruction-following judge Deterministic tool-call verifier GPT-5.5 (medium) judge model Human-calibrated LLM-as-a-Judge LLM autograding with expert validation LLM-based anti-cheating judgment LLM-based correctness judging LLM-based external API usage inspection Mandatory agentic judge protocol Official task verifier scoring Reward-hack detection judge Rule-based anti-cheat checks