implementation detail · not yet filed
AITER RMSNorm backend
Also called VLLM_ROCM_USE_AITER_RMSNORM=1.
- source
- 1
- model
- 1
- lab adopt it
- 1
- strongest
- optional
How sources treat it
One count per evidence span, weakest treatment to strongest.
optional 1
Documented in
Evidence
1 span quoted from the sources, strongest treatment first.
export VLLM_ROCM_USE_AITER_RMSNORM=1
optionalinference servingin vLLM