With the rising popularity of intelligent mobile devices, it is of great
practical significance to develop accurate, realtime and energy-efficient image
Super-Resolution (SR) inference methods. A prevailing method for improving the
inference efficiency is model quantization, which allows for replacing the
expensive floating-point operations with efficient fixed-point or bitwise
arithmetic. To date, it is still challenging for quantized SR frameworks to
deliver feasible accuracy-efficiency trade-off. Here, we propose a Fully
Quantized image Super-Resolution framework (FQSR) to jointly optimize
efficiency and accuracy. In particular, we target on obtaining end-to-end
quantized models for all layers, especially including skip connections, which
was rarely addressed in the literature. We further identify training obstacles
faced by low-bit SR networks and propose two novel methods accordingly. The two
difficulites are caused by 1) activation and weight distributions being vastly
distinctive in different layers; 2) the inaccurate approximation of the
quantization. We apply our quantization scheme on multiple mainstream
super-resolution architectures, including SRResNet, SRGAN and EDSR.
Experimental results show that our FQSR using low bits quantization can achieve
on par performance compared with the full-precision counterparts on five
benchmark datasets and surpass state-of-the-art quantized SR methods with
significantly reduced computational cost and memory consumption.

针对模型量化与 SR 网络训练中的两个困难，本文提出了一种全量化图像超分辨率框架（FQSR）来同时优化效率和精度，并在多个主流 SR 构架上应用，实验表明与全精度 SR 方法相比，FQSR 具有相同的性能和较低的计算成本。