This work targets the automated minimum-energy optimization of Quantized
Neural Networks (QNNs) - networks using low precision weights and activations.
These networks are trained from scratch at an arbitrary fixed point precision.
At iso-accuracy, QNNs using fewer bits require deeper and wider network
architectures than networks using higher precision operators, while they
require less complex arithmetic and less bits per weights. This fundamental
trade-off is analyzed and quantified to find the minimum energy QNN for any
benchmark and hence optimize energy-efficiency. To this end, the energy
consumption of inference is modeled for a generic hardware platform. This
allows drawing several conclusions across different benchmarks. First, energy
consumption varies orders of magnitude at iso-accuracy depending on the number
of bits used in the QNN. Second, in a typical system, BinaryNets or int4
implementations lead to the minimum energy solution, outperforming int8
networks up to 2-10x at iso-accuracy. All code used for QNN training is
available from this https URL

本研究针对量化神经网络（QNNs）的最小能量自动优化进行了探索和分析，发现在相同准确性的情况下，使用更少的位数的 QNNs 需要更深和更宽的网络架构，但需要较简单的算术和较少的权重位数。经过模拟推导，二进制网络或 int4 实施可以实现最小能量解，比在准确性上相同的情况下，int8 网络快 2-10 倍。