The spatio-temporal information among video sequences is significant for
video super-resolution (SR). However, the spatio-temporal information cannot be
fully used by existing video SR methods since spatial feature extraction and
temporal motion compensation are usually performed sequentially. In this paper,
we propose a deformable 3D convolution network (D3Dnet) to incorporate
spatio-temporal information from both spatial and temporal dimensions for video
SR. Specifically, we introduce deformable 3D convolution (D3D) to integrate
deformable convolution with 3D convolution, obtaining both superior
spatio-temporal modeling capability and motion-aware modeling flexibility.
Extensive experiments have demonstrated the effectiveness of D3D in exploiting
spatio-temporal information. Comparative results show that our network achieves
state-of-the-art SR performance. Code is available at:
this https URL

本文提出了一种变形 3D 卷积网络（D3Dnet）来融合来自空间和时间维度的时空信息进行视频超分辨率， 采用变形卷积与 3D 卷积相结合的方法，具有更好的时空建模能力和运动感知建模灵活性， 实验结果表明 D3D 在开发时空信息方面非常有效。