specific method · filed under model architecture
Round-robin load balancing
A load-balancing option that assigns work in round-robin order.
Also called --load-balance-method round_robin.
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- optional
How sources treat it
One count per evidence span, weakest treatment to strongest.
optional 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
--load-balance-method round_robin
optionalinference servingin MiMo-V2.5Xiaomi
Filed alongside
Other methods under model architecture :: channel mixer :: mixture of experts :: expert load balancing.
Auxiliary-loss-free load balancingQuantile BalancingHistogram-based quantile estimationAuxiliary-loss load balancingExact coordinate minimizationExpert bias update factorExpert Parallelism Load BalancingExponential moving average of estimated quantilesformHCLoad balancingMaxVioModality-specific auxiliary-loss-free load balancingPersistent load balancingPooled-global-batch quantile estimation