Single image super-resolution (SISR), as a traditional ill-conditioned
inverse problem, has been greatly revitalized by the recent development of
convolutional neural networks (CNN). These CNN-based methods generally map a
low-resolution image to its corresponding high-resolution version with
sophisticated network structures and loss functions, showing impressive
performances. This paper provides a new insight on conventional SISR algorithm,
and proposes a substantially different approach relying on the iterative
optimization. A novel iterative super-resolution network (ISRN) is proposed on
top of the iterative optimization. We first analyze the observation model of
image SR problem, inspiring a feasible solution by mimicking and fusing each
iteration in a more general and efficient manner. Considering the drawbacks of
batch normalization, we propose a feature normalization (F-Norm, FN) method to
regulate the features in network. Furthermore, a novel block with FN is
developed to improve the network representation, termed as FNB.
Residual-in-residual structure is proposed to form a very deep network, which
groups FNBs with a long skip connection for better information delivery and
stabling the training phase. Extensive experimental results on testing
benchmarks with bicubic (BI) degradation show our ISRN can not only recover
more structural information, but also achieve competitive or better PSNR/SSIM
results with much fewer parameters compared to other works. Besides BI, we
simulate the real-world degradation with blur-downscale (BD) and
downscale-noise (DN). ISRN and its extension ISRN+ both achieve better
performance than others with BD and DN degradation models.

本研究提出了一种基于迭代优化的新型迭代超分辨率网络（ISRN）来解决单幅图像超分辨率问题，使用特征归一化和残差结构来提高网络表示性能，并在多项测试基准中展示了其在恢复图像结构信息和图像质量提高方面的卓越表现。