Automatic facial action unit (AU) recognition has attracted great attention
but still remains a challenging task, as subtle changes of local facial muscles
are difficult to thoroughly capture. Most existing AU recognition approaches
leverage geometry information in a straightforward 2D or 3D manner, which
either ignore 3D manifold information or suffer from high computational costs.
In this paper, we propose a novel geodesic guided convolution (GeoConv) for AU
recognition by embedding 3D manifold information into 2D convolutions.
Specifically, the kernel of GeoConv is weighted by our introduced geodesic
weights, which are negatively correlated to geodesic distances on a coarsely
reconstructed 3D face model. Moreover, based on GeoConv, we further develop an
end-to-end trainable framework named GeoCNN for AU recognition. Extensive
experiments on BP4D and DISFA benchmarks show that our approach significantly
outperforms the state-of-the-art AU recognition methods.

本研究提出了一种将三维流形信息嵌入二维卷积的新颖方法 —— 地形引导卷积（GeoConv），并基于 GeoConv，开发了一种名为 GeoCNN 的端到端可训练框架，用于面部动作单元（AU）的识别。BP4D 和 DISFA 基准测试的广泛实验表明，我们的方法显著优于现有的 AU 识别方法。