We propose a new face recognition method, called a pairwise relational
network (PRN), which takes local appearance features around landmark points on
the feature map, and captures unique pairwise relations with the same identity
and discriminative pairwise relations between different identities. The PRN
aims to determine facial part-relational structure from local appearance
feature pairs. Because meaningful pairwise relations should be identity
dependent, we add a face identity state feature, which obtains from the long
short-term memory (LSTM) units network with the sequential local appearance
features. To further improve accuracy, we combined the global appearance
features with the pairwise relational feature. Experimental results on the LFW
show that the PRN achieved 99.76% accuracy. On the YTF, PRN achieved the
state-of-the-art accuracy (96.3%). The PRN also achieved comparable results to
the state-of-the-art for both face verification and face identification tasks
on the IJB-A and IJB-B. This work is already published on ECCV 2018.

提出了一种新的人脸识别方法，称为对比关系网络，该网络利用特征图上地标点周围的局部外观特征，捕捉相同身份的独特对比关系和不同身份之间的有区别性的对比关系，并通过添加面部身份状态特征来进一步提高准确性。

利用本地外貌特征的两两关系网络进行人脸识别

Pairwise Relational Networks using Local Appearance Features for Face  Recognition

Existing face recognition using deep neural networks is difficult to know
what kind of features are used to discriminate the identities of face images
clearly. To investigate the effective features for face recognition, we propose
a novel face recognition method, called a pairwise relational network (PRN),
that obtains local appearance patches around landmark points on the feature
map, and captures the pairwise relation between a pair of local appearance
patches. The PRN is trained to capture unique and discriminative pairwise
relations among different identities. Because the existence and meaning of
pairwise relations should be identity dependent, we add a face identity state
feature, which obtains from the long short-term memory (LSTM) units network
with the sequential local appearance patches on the feature maps, to the PRN.
To further improve accuracy of face recognition, we combined the global
appearance representation with the pairwise relational feature. Experimental
results on the LFW show that the PRN using only pairwise relations achieved
99.65% accuracy and the PRN using both pairwise relations and face identity
state feature achieved 99.76% accuracy. On the YTF, both the PRN using only
pairwise relations and the PRN using pairwise relations and the face identity
state feature achieved the state-of-the-art (95.7% and 96.3%). The PRN also
achieved comparable results to the state-of-the-art for both face verification
and face identification tasks on the IJB-A, and the state-of-the-art on the
IJB-B.

本文提出了一种基于 pairwise relational network (PRN) 的人脸识别方法，使用本地外观补丁捕捉局部特征并捕捉不同身份之间独特而具有区分性的成对关系，融合全局特征表示和面部身份状态特征来进一步提高准确性，在 LFW、YTF 和 IJB 数据集上都获得了良好的实验效果。