specific method · filed under model architecture
Exact Quantile Balancing
Exact Quantile Balancing is an expert load balancing method that adjusts token and expert biases through alternating quantile updates to balance expert loads.1 It routes with top-K of the biased logits and maintains global balance without a tunable balancing hyperparameter.2,3
How this definition was written
Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.
computes token biases α∈ RT and expert biases β through alternating quantile updates
— tech reportwe use the top-K of the biased logits for routing
— tech reportEQB maintains stable global load balance without a tunable balancing hyperparameter
— tech report
Also called Exact Quantile Balancing (EQB).