single mention · model architecture
DP-aware routing
Routes experts to preserve KV-cache locality during data-parallel MoE inference.
The sources on this page name it without explaining how it works. The line above is the extraction's one-line gloss. See expert routing for the methods filed beside it.
Also called DP-aware routing mechanism.
Filed under model architecture › channel mixer › mixture of experts › expert routing