Post-training quantization (PTQ) efficiently compresses vision models, but
unfortunately, it accompanies a certain degree of accuracy degradation.
Reconstruction methods aim to enhance model performance by narrowing the gap
between the quantized model and the full-precision model, often yielding
promising results. However, efforts to significantly improve the performance of
PTQ through reconstruction in the Vision Transformer (ViT) have shown limited
efficacy. In this paper, we conduct a thorough analysis of the reasons for this
limited effectiveness and propose MGRQ (Mixed Granularity Reconstruction
Quantization) as a solution to address this issue. Unlike previous
reconstruction schemes, MGRQ introduces a mixed granularity reconstruction
approach. Specifically, MGRQ enhances the performance of PTQ by introducing
Extra-Block Global Supervision and Intra-Block Local Supervision, building upon
Optimized Block-wise Reconstruction. Extra-Block Global Supervision considers
the relationship between block outputs and the model's output, aiding
block-wise reconstruction through global supervision. Meanwhile, Intra-Block
Local Supervision reduces generalization errors by aligning the distribution of
outputs at each layer within a block. Subsequently, MGRQ is further optimized
for reconstruction through Mixed Granularity Loss Fusion. Extensive experiments
conducted on various ViT models illustrate the effectiveness of MGRQ. Notably,
MGRQ demonstrates robust performance in low-bit quantization, thereby enhancing
the practicality of the quantized model.

本文通过分析深入探讨原因，并提出了 MGRQ（混合粒度重构量化）作为解决方案以解决此问题。MGRQ 引入了一种混合粒度重构方法来提高 PTQ 的性能，并通过引入 Extra-Block 全局监督和 Intra-Block 本地监督，构建了优化的块重构模型。通过多种 ViT 模型进行的广泛实验证明了 MGRQ 的有效性，尤其在低位量化下表现出稳健的性能，从而提高了量化模型的实用性。