Facial expression analysis in the wild is challenging when the facial image
is with low resolution or partial occlusion. Considering the correlations among
different facial local regions under different facial expressions, this paper
proposes a novel facial expression restoration method based on generative
adversarial network by integrating an improved graph convolutional network
(IGCN) and region relation modeling block (RRMB). Unlike conventional graph
convolutional networks taking vectors as input features, IGCN can use tensors
of face patches as inputs. It is better to retain the structure information of
face patches. The proposed RRMB is designed to address facial generative tasks
including inpainting and super-resolution with facial action units detection,
which aims to restore facial expression as the ground-truth. Extensive
experiments conducted on BP4D and DISFA benchmarks demonstrate the
effectiveness of our proposed method through quantitative and qualitative
evaluations.

本文提出了一种基于生成对抗网络的新型面部表情恢复方法，结合了改进的图卷积网络和区域关系建模块，旨在通过面部行为单元检测，解决包括修复和超分辨率等面部生成任务，并在 BP4D 和 DISFA 基准上进行了大量实验，定量和定性地证明了我们提出的方法的有效性。