Feb, 2024
通过一致性规则将量化感知训练推向全精度性能
Push Quantization-Aware Training Toward Full Precision Performances via Consistency Regularization
Junbiao Pang, Tianyang Cai, Baochang Zhang, Jiaqi Wu, Ye Tao
TL;DR该论文介绍了一种新颖的方法 ——Consistency Regularization(CR),通过将邻近数据分布信息注入到 Quantization-Aware Training(QAT)中,有效提高了 QAT 的泛化性能,实验证明该方法显著优于当前最先进的 QAT 方法和 Full Precision(FP)对照组。