general family · filed under optimization
Quantization-Aware Training
Quantization-Aware Training integrates quantization into the training process so the model adapts to the precision loss from quantization.1,2 It simulates quantization during training, which preserves model quality better than post-training quantization when compressing.3
Trade-off Compared with standard post-training quantization, QAT yields higher model quality, enabling smaller memory footprints while preserving capabilities.4
How this definition was written
Summarised by glm-5.3-flash from 2 sources; every sentence is checked against the quote it cites.
QAT integrates the quantization process directly into training
— Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiencyenabling the model, including those of teacher and reference models, to adapt to the precision degradation introduced by quantization
— DeepSeek-V4: Towards Highly Efficient Million-Token Context IntelligenceBy simulating quantization during training, QAT minimizes quality loss when the model is compressed
— Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiencyour QAT results yield even higher overall quality compared to standard PTQ baselines
— Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
Also called Quantization-Aware Training (QAT).