BriefGPT.xyz
Jun, 2021
使用跨流原型对比的自监督视频表示学习
Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting
HTML
PDF
Martine Toering, Ioannis Gatopoulos, Maarten Stol, Vincent Tao Hu
TL;DR
本文提出了一种新的方法“Video Cross-Stream Prototypical Contrasting”,结合RGB和光流视图预测出一致的原型赋值,从而学习到嵌入动态信息的更高效的视频嵌入,取得了最佳的最近邻视频检索和动作识别结果。
Abstract
instance-level contrastive learning
techniques, which rely on data augmentation and a contrastive loss function, have found great success in the domain of
visual representation learning
. They are not suitable for
→