Image-text matching tasks have recently attracted a lot of attention in the
computer vision field. The key point of this cross-domain problem is how to
accurately measure the similarity between the visual and the textual contents,
which demands a fine understanding of both modalities. In this paper, we
propose a novel position focused attention network (PFAN) to investigate the
relation between the visual and the textual views. In this work, we integrate
the object position clue to enhance the visual-text joint-embedding learning.
We first split the images into blocks, by which we infer the relative position
of region in the image. Then, an attention mechanism is proposed to model the
relations between the image region and blocks and generate the valuable
position feature, which will be further utilized to enhance the region
expression and model a more reliable relationship between the visual image and
the textual sentence. Experiments on the popular datasets Flickr30K and MS-COCO
show the effectiveness of the proposed method. Besides the public datasets, we
also conduct experiments on our collected practical large-scale news dataset
(Tencent-News) to validate the practical application value of proposed method.
As far as we know, this is the first attempt to test the performance on the
practical application. Our method achieves the state-of-art performance on all
of these three datasets.

本论文介绍了一种基于位置关注的注意网络（PFAN），以解决图像和文本匹配任务中精确度量视觉和文本内容相似性的跨域问题，通过引入对象位置线索和注意机制，增强了图像和文本的特征表达和可信关系，从而实现了三个数据集上的最先进性能水平，包括我们自己收集的实际大规模新闻数据集 Tencent-News 上的实际应用价值验证。