Low-precision networks, with weights and activations quantized to low
bit-width, are widely used to accelerate inference on edge devices. However,
current solutions are uniform, using identical bit-width for all filters. This
fails to account for the different sensitivities of different filters and is
suboptimal. Mixed-precision networks address this problem, by tuning the
bit-width to individual filter requirements. In this work, the problem of
optimal mixed-precision network search (MPS) is considered. To circumvent its
difficulties of discrete search space and combinatorial optimization, a new
differentiable search architecture is proposed, with several novel
contributions to advance the efficiency by leveraging the unique properties of
the MPS problem. The resulting Efficient differentiable MIxed-Precision network
Search (EdMIPS) method is effective at finding the optimal bit allocation for
multiple popular networks, and can search a large model, e.g. Inception-V3,
directly on ImageNet without proxy task in a reasonable amount of time. The
learned mixed-precision networks significantly outperform their uniform
counterparts.

该研究旨在解决低精度网络中过滤器位宽不同敏感性也不同的问题，提出了一种新型可微分搜索架构 ——Efficient differentiable Mixed-Precision network Search（EdMIPS），采用该方法能够高效地寻找多种流行网络最佳位分配，且搜索速度快，学习到的混合精度网络性能显著优于其均匀位宽网络。