In this paper, we propose a residual non-local attention network for
high-quality image restoration. Without considering the uneven distribution of
information in the corrupted images, previous methods are restricted by local
convolutional operation and equal treatment of spatial- and channel-wise
features. To address this issue, we design local and non-local attention blocks
to extract features that capture the long-range dependencies between pixels and
pay more attention to the challenging parts. Specifically, we design trunk
branch and (non-)local mask branch in each (non-)local attention block. The
trunk branch is used to extract hierarchical features. Local and non-local mask
branches aim to adaptively rescale these hierarchical features with mixed
attentions. The local mask branch concentrates on more local structures with
convolutional operations, while non-local attention considers more about
long-range dependencies in the whole feature map. Furthermore, we propose
residual local and non-local attention learning to train the very deep network,
which further enhance the representation ability of the network. Our proposed
method can be generalized for various image restoration applications, such as
image denoising, demosaicing, compression artifacts reduction, and
super-resolution. Experiments demonstrate that our method obtains comparable or
better results compared with recently leading methods quantitatively and
visually.

本文提出了残差非局部注意力网络用于高质量图像恢复，利用局部和非局部注意块来提取长程依赖的特征并对挑战性部分进行更多关注，在局部和非局部注意力学习中加入残差机制以增强网络的表征能力，可以被推广应用于各种图像恢复应用中，如图像去噪，去马赛克，压缩失真减少和超分辨率。实验结果表明，我们的方法在定量和定性指标上都取得了可比或更好的结果。