Weakly supervised segmentation methods using bounding box annotations focus
on obtaining a pixel-level mask from each box containing an object. Existing
methods typically depend on a class-agnostic mask generator, which operates on
the low-level information intrinsic to an image. In this work, we utilize
higher-level information from the behavior of a trained object detector, by
seeking the smallest areas of the image from which the object detector produces
almost the same result as it does from the whole image. These areas constitute
a bounding-box attribution map (BBAM), which identifies the target object in
its bounding box and thus serves as pseudo ground-truth for weakly supervised
semantic and instance segmentation. This approach significantly outperforms
recent comparable techniques on both the PASCAL VOC and MS COCO benchmarks in
weakly supervised semantic and instance segmentation. In addition, we provide a
detailed analysis of our method, offering deeper insight into the behavior of
the BBAM.

本研究利用训练的物体检测器的行为高级信息，寻求影响物体检测器结果的最小区域，形成 bound box attribution map（BBAM)。该方法基于伪标注数据进行弱监督的语义及实例分割，能提高 PASCAL VOC 和 MS COCO 数据集的分割结果。

弱监督语义和实例分割的边框归因映射

BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and  Instance Segmentation

Acquiring sufficient ground-truth supervision to train deep visual models has
been a bottleneck over the years due to the data-hungry nature of deep
learning. This is exacerbated in some structured prediction tasks, such as
semantic segmentation, which requires pixel-level annotations. This work
addresses weakly supervised semantic segmentation (WSSS), with the goal of
bridging the gap between image-level annotations and pixel-level segmentation.
We formulate WSSS as a novel group-wise learning task that explicitly models
semantic dependencies in a group of images to estimate more reliable pseudo
ground-truths, which can be used for training more accurate segmentation
models. In particular, we devise a graph neural network (GNN) for group-wise
semantic mining, wherein input images are represented as graph nodes, and the
underlying relations between a pair of images are characterized by an efficient
co-attention mechanism. Moreover, in order to prevent the model from paying
excessive attention to common semantics only, we further propose a graph
dropout layer, encouraging the model to learn more accurate and complete object
responses. The whole network is end-to-end trainable by iterative message
passing, which propagates interaction cues over the images to progressively
improve the performance. We conduct experiments on the popular PASCAL VOC 2012
and COCO benchmarks, and our model yields state-of-the-art performance. Our
code is available at: this https URL

本研究提出一种基于图神经网络的弱监督语义分割方法，将图像表示为图的节点，使用组内注意力机制建立图中的关系，通过迭代信息传递的方式学习更准确、更完整的物体响应，并在多个基准数据集上取得了最先进的性能。