Video super-resolution (SR) aims to generate a sequence of high-resolution
(HR) frames with plausible and temporally consistent details from their
low-resolution (LR) counterparts. The generation of accurate correspondence
plays a significant role in video SR. It is demonstrated by traditional video
SR methods that simultaneous SR of both images and optical flows can provide
accurate correspondences and better SR results. However, LR optical flows are
used in existing deep learning based methods for correspondence generation. In
this paper, we propose an end-to-end trainable video SR framework to
super-resolve both images and optical flows. Specifically, we first propose an
optical flow reconstruction network (OFRnet) to infer HR optical flows in a
coarse-to-fine manner. Then, motion compensation is performed according to the
HR optical flows. Finally, compensated LR inputs are fed to a super-resolution
network (SRnet) to generate the SR results. Extensive experiments demonstrate
that HR optical flows provide more accurate correspondences than their LR
counterparts and improve both accuracy and consistency performance. Comparative
results on the Vid4 and DAVIS-10 datasets show that our framework achieves the
state-of-the-art performance.

本文提出了一个端到端可训练的视频超分辨率框架，使用 HR 光流可提供更精确的对应关系并提高性能。在 Vid4 和 DAVIS-10 数据集上进行的比较结果显示，我们的框架实现了最先进的表现。