How to effectively fuse cross-modal information is the key problem for RGB-D
salient object detection. Early fusion and the result fusion schemes fuse RGB
and depth information at the input and output stages, respectively, hence incur
the problem of distribution gap or information loss. Many models use the
feature fusion strategy but are limited by the low-order point-to-point fusion
methods. In this paper, we propose a novel mutual attention model by fusing
attention and contexts from different modalities. We use the non-local
attention of one modality to propagate long-range contextual dependencies for
the other modality, thus leveraging complementary attention cues to perform
high-order and trilinear cross-modal interaction. We also propose to induce
contrast inference from the mutual attention and obtain a unified model.
Considering low-quality depth data may detriment the model performance, we
further propose selective attention to reweight the added depth cues. We embed
the proposed modules in a two-stream CNN for RGB-D SOD. Experimental results
have demonstrated the effectiveness of our proposed model. Moreover, we also
construct a new challenging large-scale RGB-D SOD dataset with high-quality,
thus can both promote the training and evaluation of deep models.

本文旨在解决如何有效地融合 RGB-D 信息来进行显著目标检测的关键问题。通过提出一个新的互惠关注模型来融合来自不同模态的注意力和上下文信息，实现高阶和三线性交叉信息互补，从而提高 RGB-D SOD 的模型性能。同时，通过添加选择性关注来重新加权深度相关信息，提高模型的鲁棒性。在两个数据集上的实验验证了该模型的有效性。