In recent years, real image super-resolution (SR) has achieved promising
results due to the development of SR datasets and corresponding real SR
methods. In contrast, the field of real video SR is lagging behind, especially
for real raw videos. Considering the superiority of raw image SR over sRGB
image SR, we construct a real-world raw video SR (Real-RawVSR) dataset and
propose a corresponding SR method. We utilize two DSLR cameras and a
beam-splitter to simultaneously capture low-resolution (LR) and high-resolution
(HR) raw videos with 2x, 3x, and 4x magnifications. There are 450 video pairs
in our dataset, with scenes varying from indoor to outdoor, and motions
including camera and object movements. To our knowledge, this is the first
real-world raw VSR dataset. Since the raw video is characterized by the Bayer
pattern, we propose a two-branch network, which deals with both the packed RGGB
sequence and the original Bayer pattern sequence, and the two branches are
complementary to each other. After going through the proposed co-alignment,
interaction, fusion, and reconstruction modules, we generate the corresponding
HR sRGB sequence. Experimental results demonstrate that the proposed method
outperforms benchmark real and synthetic video SR methods with either raw or
sRGB inputs. Our code and dataset are available at
this https URL

提出了一个名为 Real-RawVSR 的实际原始视频超分辨率 (Raw Video Super-Resolution) 数据集，包含了 450 个不同场景下的低分辨率和高分辨率视频对，并利用两个 DSLR 相机和一个分束器进行采集，同时提出了一种基于两种 RGGB 和原始 Bayer 模式交替使用的两支分支网络，以生成对应的高分辨率 sRGB 图像。实验结果表明，该方法在处理是原始和 sRGB 输入的真实和合成视频上优于基准方法。