We propose an approach to discover class-specific pixels for the weakly-supervised semantic segmentation task. We show that properly combining saliency and attention maps allows us to obtain reliable cues capable of significantly boosting the performance. First, we propose a simple yet powerful hierarchical approach to discover the class-agnostic salient regions, obtained using a salient object detector, which otherwise would be ignored. Second, we use fully convolutional attention maps to reliably localize the class-specific regions in a given image. We combine these two cues to discover class-specific pixels which are then used as an approximate ground truth for training a CNN. While solving the weakly supervised semantic segmentation task, we ensure that the image-level classification task is also solved in order to enforce the CNN to assign at least one pixel to each object present in the image. Experimentally, on the PASCAL VOC12 val and test sets, we obtain the mIoU of 60.8% and 61.9%, achieving the performance gains of 5.1% and 5.2% compared to the published state-of-the-art results. The code is made publicly available.

该研究提出一种发现类特定像素的方法，需要通过正确地结合显著性和注意力图才能获得可靠的线索，该方法将二者的可靠性信息组合使用，以训练卷积神经网络以在弱监督语义分割任务和图像级分类任务上实现更好的性能，实验证明，该方法在 PASCAL VOC12 数据集上取得了比以往最好结果更好的成绩。

弱监督语义分割中发现类特定像素