Step-3.7-Flash
StepFun--moe-runner-backend flashinfer_trtllm
usedsoftware implementationin Step 3.7 Flash NVFP4StepFun
1 more from this model
--moe-runner-backend flashinfer_trtllm
optionalsoftware implementationin Step 3.7 Flash NVFP4StepFun
implementation detail · filed under software implementation
A FlashInfer backend selected for the TensorRT-LLM MoE runner.
The sources on this page only mention it in passing. The line above is the extraction's one-line gloss. See kernel & quantization library for the methods filed beside it.
Also called flashinfer_trtllm.
2 quotes from 2 sources, one card per model, each opening with its strongest.
--moe-runner-backend flashinfer_trtllm
--moe-runner-backend flashinfer_trtllm