We propose a new video camouflaged object detection (VCOD) framework that can
exploit both short-term dynamics and long-term temporal consistency to detect
camouflaged objects from video frames. An essential property of camouflaged
objects is that they usually exhibit patterns similar to the background and
thus make them hard to identify from still images. Therefore, effectively
handling temporal dynamics in videos becomes the key for the VCOD task as the
camouflaged objects will be noticeable when they move. However, current VCOD
methods often leverage homography or optical flows to represent motions, where
the detection error may accumulate from both the motion estimation error and
the segmentation error. On the other hand, our method unifies motion estimation
and object segmentation within a single optimization framework. Specifically,
we build a dense correlation volume to implicitly capture motions between
neighbouring frames and utilize the final segmentation supervision to optimize
the implicit motion estimation and segmentation jointly. Furthermore, to
enforce temporal consistency within a video sequence, we jointly utilize a
spatio-temporal transformer to refine the short-term predictions. Extensive
experiments on VCOD benchmarks demonstrate the architectural effectiveness of
our approach. We also provide a large-scale VCOD dataset named MoCA-Mask with
pixel-level handcrafted ground-truth masks and construct a comprehensive VCOD
benchmark with previous methods to facilitate research in this direction.
Dataset Link: this https URL

提出了一种新的视频伪装目标检测 (VCOD) 框架，可以利用短期动态和长期时间一致性来检测视频帧中的伪装目标，采用单一优化框架统一了运动估计和对象分割，并使用空间 - 时间变换器从而有效地处理视频的时间动态，提供了一个名为 MoCA-Mask 的大规模 VCOD 数据集，为该方向的研究建立了综合性的基准测试。