Self-supervised representation learning for visual pre-training has achieved
remarkable success with sample (instance or pixel) discrimination and semantics
discovery of instance, whereas there still exists a non-negligible gap between
pre-trained model and downstream dense prediction tasks. Concretely, these
downstream tasks require more accurate representation, in other words, the
pixels from the same object must belong to a shared semantic category, which is
lacking in the previous methods. In this work, we present Dense Semantic
Contrast (DSC) for modeling semantic category decision boundaries at a dense
level to meet the requirement of these tasks. Furthermore, we propose a dense
cross-image semantic contrastive learning framework for multi-granularity
representation learning. Specially, we explicitly explore the semantic
structure of the dataset by mining relations among pixels from different
perspectives. For intra-image relation modeling, we discover pixel neighbors
from multiple views. And for inter-image relations, we enforce pixel
representation from the same semantic class to be more similar than the
representation from different classes in one mini-batch. Experimental results
show that our DSC model outperforms state-of-the-art methods when transferring
to downstream dense prediction tasks, including object detection, semantic
segmentation, and instance segmentation. Code will be made available.

本文提出了一种密集的语义对比学习框架，用于多颗粒度表示学习，以模拟语义类别决策边界以满足下游的密集预测任务，实验证明我们的模型优于现有的方法，包括目标检测、语义分割和实例分割。