general family · filed under software implementation
Model routing and orchestration
Model routing and orchestration support division of labor between models and are available through NVIDIA NeMo Switchyard.
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- optional
How sources treat it
One count per evidence span, weakest treatment to strongest.
optional 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
Model routing and orchestration help make this division of labor more accessible. They are now available through NVIDIA NeMo Switchyard.
optionalinference servingin NeMo SwitchyardNVIDIA
Filed alongside
Other methods under software implementation.