To bridge the ever increasing gap between deep neural networks' complexity
and hardware capability, network quantization has attracted more and more
research attention. The latest trend of mixed precision quantization takes
advantage of hardware's multiple bit-width arithmetic operations to unleash the
full potential of network quantization. However, this also results in a
difficult integer programming formulation, and forces most existing approaches
to use an extremely time-consuming search process even with various
relaxations. Instead of solving a problem of the original integer programming,
we propose to optimize a proxy metric, the concept of network orthogonality,
which is highly correlated with the loss of the integer programming but also
easy to optimize with linear programming. This approach reduces the search time
and required data amount by orders of magnitude, with little compromise on
quantization accuracy. Specifically, we achieve 72.08% Top-1 accuracy on
ResNet-18 with 6.7Mb, which does not require any searching iterations. Given
the high efficiency and low data dependency of our algorithm, we used it for
the post-training quantization, which achieve 71.27% Top-1 accuracy on
MobileNetV2 with only 1.5Mb. Our code is available at
this https URL

提出使用网络正交性作为网络量化的代理指标，使用线性规划优化代理指标，降低搜索时间和数据依赖性，从而实现高效且准确的网络量化，分别在 ResNet-18 和 MobileNetV2 上实现了 72.08% 和 71.27% 的 Top-1 准确率。