Video frame interpolation(VFI) has witnessed great progress in recent years.
While existing VFI models still struggle to achieve a good trade-off between
accuracy and efficiency: fast models often have inferior accuracy; accurate
models typically run slowly. However, easy samples with small motion or clear
texture can achieve competitive results with simple models and do not require
heavy computation. In this paper, we present an integrated pipeline which
combines difficulty assessment with video frame interpolation. Specifically, it
firstly leverages a pre-assessment model to measure the interpolation
difficulty level of input frames, and then dynamically selects an appropriate
VFI model to generate interpolation results. Furthermore, a large-scale VFI
difficulty assessment dataset is collected and annotated to train our
pre-assessment model. Extensive experiments show that easy samples pass through
fast models while difficult samples inference with heavy models, and our
proposed pipeline can improve the accuracy-efficiency trade-off for VFI.

本文介绍了一个整合了难度评估和视频帧插值的管道，该管道首先利用先前评估模型对输入帧的插值难度级别进行量化，然后动态选择适当的插值模型生成插值结果，极大地提高了视频帧插值的准确度和效率。