Quantization-aware training
Also called qat
Simulating low precision during training so the model learns to work well in it. It does not make training faster.
Interview questions about Quantization-aware training
- Explain quantization-aware training, knowledge distillation, eval mode and contrastive learning. How would you verify that each one improved a production model?
Quantization-aware training simulates low-precision rounding during fine-tuning, so accuracy holds better than post-training quantization.