Open Models Almanac
Methodsinference & servinginference quantization

specific method · filed under inference & serving

Max-based weight scaling

Max-based weight scaling is a quantization scale-selection rule that sets each per-block quantization scale from the block's absolute maximum.1 It is one of several FP4 post-training weight scale-selection strategies, alongside MSE-based and Four-Over-Six scaling.2

Trade-off MSE-based scaling slightly outperforms max in conservative quantization settings, though they are comparable in aggressive settings.3

How this definition was written

Summarised by glm-5.3-flash from 2 sources; every sentence is checked against the quote it cites.

  1. max-based scaling uses the block absolute maximum — Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
  2. For weights, we experimented with max-based, MSE-based, and Four-Over-Six — NVIDIA Nemotron 3 Ultra Technical Report
  3. in more conservative quantization settings of 5.03 or 5.43 BPE, MSE slightly outperforms max, whereas in the aggressive quantization setting of 4.85 BPE, they are comparable — NVIDIA Nemotron 3 Ultra Technical Report

Also called Max-based quantization scale calibration, max-based scaling.

sources
2
model
1
labs adopt it
0
strongest
evaluated

Documented in

Evidence

2 quotes from 2 sources, one card per model, each opening with its strongest.

How sources treat it
evaluated 2
↑