Open Models Almanac
Methodsinference & servinginference scheduling

specific method · filed under inference & serving

NUMA binding for GPU-local CPU affinity

NUMA binding pins worker processes to the CPU socket local to their assigned GPUs.1 It prevents cross-socket placement, which would force memory traffic over the inter-socket coherence link and degrade GPU memory bandwidth.2

How this definition was written

Summarised by glm-5.3-flash from 1 source; every sentence is checked against the quote it cites.

  1. explicitly bind policy and vLLM worker processes to the CPU socket local to their assigned GPUs — NVIDIA Nemotron 3 Ultra Technical Report
  2. cross- socket placement forces memory traffic to traverse the inter-socket coherence link before reaching NVLink-C2C, degrading GPU memory bandwidth — NVIDIA Nemotron 3 Ultra Technical Report

Also called NUMA Binding for CPU-GPU affinity, NUMA Binding.

sources
2
model
1
lab adopt it
1
strongest
used

Documented in

Evidence

2 quotes from 2 sources, one card per model, each opening with its strongest.

How sources treat it
used 2

NVIDIA-Nemotron-3-Ultra-550B-A55B

NVIDIAadopted2 sources

The fix was to explicitly bind policy and vLLM worker processes to the CPU socket local to their assigned GPUs.

usedsoftware implementationin NeMo-RLNVIDIA
1 more from this model

The fix was to explicitly bind policy and vLLM worker processes to the CPU socket local to their assigned GPUs.

usedsoftware implementationin Nemotron 3 UltraNVIDIA
↑