Facial action unit (AU) recognition is a crucial task for facial expressions
analysis and has attracted extensive attention in the field of artificial
intelligence and computer vision. Existing works have either focused on
designing or learning complex regional feature representations, or delved into
various types of AU relationship modeling. Albeit with varying degrees of
progress, it is still arduous for existing methods to handle complex
situations. In this paper, we investigate how to integrate the semantic
relationship propagation between AUs in a deep neural network framework to
enhance the feature representation of facial regions, and propose an AU
semantic relationship embedded representation learning (SRERL) framework.
Specifically, by analyzing the symbiosis and mutual exclusion of AUs in various
facial expressions, we organize the facial AUs in the form of structured
knowledge-graph and integrate a Gated Graph Neural Network (GGNN) in a
multi-scale CNN framework to propagate node information through the graph for
generating enhanced AU representation. As the learned feature involves both the
appearance characteristics and the AU relationship reasoning, the proposed
model is more robust and can cope with more challenging cases, e.g.,
illumination change and partial occlusion. Extensive experiments on the two
public benchmarks demonstrate that our method outperforms the previous work and
achieves state of the art performance.

本研究提出了基于知识图谱的面部动作单位识别建模框架，采用深层神经网络框架结合全局图神经网络进行语义关系传播，旨在增强面部区域特征提取提高面部表情识别性能，实验表明该方法在面部动作单位识别上取得了最佳表现。