We present a large-scale study on unsupervised spatiotemporal representation
learning from videos. With a unified perspective on four recent image-based
frameworks, we study a simple objective that can easily generalize all these
methods to space-time. Our objective encourages temporally-persistent features
in the same video, and in spite of its simplicity, it works surprisingly well
across: (i) different unsupervised frameworks, (ii) pre-training datasets,
(iii) downstream datasets, and (iv) backbone architectures. We draw a series of
intriguing observations from this study, e.g., we discover that encouraging
long-spanned persistency can be effective even if the timespan is 60 seconds.
In addition to state-of-the-art results in multiple benchmarks, we report a few
promising cases in which unsupervised pre-training can outperform its
supervised counterpart. Code is made available at
this https URL

本文通过对四个最新的基于图像的视角的统一，提出了一种可以很好地概括所有这些方法的简单目标，该目标鼓励同一视频中的时间持久特征，在不同的无监督框架、预训练数据集、下游数据集和骨干架构中效果惊人，我们从该研究中得出了一系列有趣的观察结果，例如，即使时间跨度为 60 秒，鼓励长时间持久性也可以很有效。