specific method · filed under software implementation
NeMo Switchyard
Routes prompts to models according to configurable routing profiles for agent workflow steps.
Also called NeMo Switchyard model routing.
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- used
How sources treat it
One count per evidence span, weakest treatment to strongest.
used 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
It routes prompts to the most capable and efficient model for each step of an agent workflow automatically, based on configurable routing profiles
usedinference servingin NeMo SwitchyardNVIDIA
Filed alongside
Other methods under software implementation :: infrastructure service.
Automatic provider failoverCustom placement engineDeepSeek Elastic Compute (DSec)Dependency unificationDurable peer mailboxEnd-to-end lineageFresh-clone repository sanitizationHTTP/HTTPS sidecar proxyIn-house batch schedulerIncremental sandbox checkpointing and resumptionLocal container-image cachingModel FactoryMooncakeNeMo GuardrailsPer-node pooling of initialization actorsRayReplacing short-lived Ray actors with tasksSandbox pause and resumeVendoring external dependenciesWrite-ahead logZ3 SMT solver integration