Learning long-term spatial-temporal features are critical for many video
analysis tasks. However, existing video segmentation methods predominantly rely
on static image segmentation techniques, and methods capturing temporal
dependency for segmentation have to depend on pretrained optical flow models,
leading to suboptimal solutions for the problem. End-to-end sequential learning
to explore spatial-temporal features for video segmentation is largely limited
by the scale of available video segmentation datasets, i.e., even the largest
video segmentation dataset only contains 90 short video clips. To solve this
problem, we build a new large-scale video object segmentation dataset called
YouTube Video Object Segmentation dataset (YouTube-VOS). Our dataset contains
3,252 YouTube video clips and 78 categories including common objects and human
activities. This is by far the largest video object segmentation dataset to our
knowledge and we have released it at this https URL Based on this
dataset, we propose a novel sequence-to-sequence network to fully exploit
long-term spatial-temporal information in videos for segmentation. We
demonstrate that our method is able to achieve the best results on our
YouTube-VOS test set and comparable results on DAVIS 2016 compared to the
current state-of-the-art methods. Experiments show that the large scale dataset
is indeed a key factor to the success of our model.

本文介绍了一个基于大规模数据集的序列 - 序列网络，能够充分利用视频的长期时空信息进行分割，在 YouTube-VOS 测试集上取得了最佳结果，在 DAVIS 2016 上与现有最先进方法相比也有可比性。