Facial action unit (AU) recognition is essential to facial expression
analysis. Since there are highly positive or negative correlations between AUs,
some existing AU recognition works have focused on modeling AU relations.
However, previous relationship-based approaches typically embed predefined
rules into their models and ignore the impact of various AU relations in
different crowds. In this paper, we propose a novel Attention Based Relation
Network (ABRNet) for AU recognition, which can automatically capture AU
relations without unnecessary or even disturbing predefined rules. ABRNet uses
several relation learning layers to automatically capture different AU
relations. The learned AU relation features are then fed into a self-attention
fusion module, which aims to refine individual AU features with attention
weights to enhance the feature robustness. Furthermore, we propose an AU
relation dropout strategy and AU relation loss (AUR-Loss) to better model AU
relations, which can further improve AU recognition. Extensive experiments show
that our approach achieves state-of-the-art performance on the DISFA and DISFA+
datasets.

本文提出了一种基于注意力机制的关系网络（ABRNet），该网络可以自动捕获不同 AU 之间的关系，使用自我注意力融合模块来提高特征的稳健性，并提出了 AU 关系丢失策略和 AU 关系损失来进一步改善 AU 识别。实验证明，该方法在 DISFA 和 DISFA+ 数据集上实现了最先进的性能。