Visual relationship detection, as a challenging task used to find and
distinguish the interactions between object pairs in one image, has received
much attention recently. In this work, we propose a novel visual relationship
detection framework by deeply mining and utilizing relative location of
object-pair in every stage of the procedure. In both the stages, relative
location information of each object-pair is abstracted and encoded as auxiliary
feature to improve the distinguishing capability of object-pairs proposing and
predicate recognition, respectively; Moreover, one Gated Graph Neural
Network(GGNN) is introduced to mine and measure the relevance of predicates
using relative location. With the location-based GGNN, those non-exclusive
predicates with similar spatial position can be clustered firstly and then be
smoothed with close classification scores, thus the accuracy of top $n$ recall
can be increased further. Experiments on two widely used datasets VRD and VG
show that, with the deeply mining and exploiting of relative location
information, our proposed model significantly outperforms the current
state-of-the-art.

本文提出了一种基于物体对位置深度挖掘的视觉关系检测框架，通过使用 Gated Graph Neural Network 获取谓词间的相关性。在数据集 VRD 和 VG 上的实验结果表明，相对位置信息的挖掘和利用可以显著提高模型的性能。