Open Models Almanac
Methodsoptimizationtraining stability

specific method · filed under optimization

Router replay

Re-executes inference-time expert-routing decisions during training to prevent divergence from router drift.

The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See training stability for the methods filed beside it.

sources
2
models
3
labs adopt it
2
strongest
used

Documented in

Evidence

2 quotes from 2 sources, one card per model, each opening with its strongest.

How sources treat it
used 2

Mistral-Large-4

Mistral AIadopted1 source

router replay re-executes the expert-routing decisions made at inference time during the training forward pass, eliminating divergence caused by router drift.

usedunclearin Mistral Large 4Mistral AI
↑