BriefGPT.xyz
Sep, 2023
构建语义间隔以实现语言引导的语义分割
Bridging Semantic Gaps for Language-Supervised Semantic Segmentation
HTML
PDF
Yun Xing, Jian Kang, Aoran Xiao, Jiahao Nie, Shao Ling...
TL;DR
通过提出概念整理(CoCu)的流程,借助CLIP来弥补语义缺失,将视觉和文本语义之间的差距缩小,从而在预训练数据中增加了更多的视觉概念,并在零样本迁移和语义分割等方面取得了卓越的性能。
Abstract
vision-language pre-training
has demonstrated its remarkable zero-shot recognition ability and potential to learn generalizable visual representations from language supervision. Taking a step ahead,
language-supervised
→