We propose a novel method for real-time face alignment in videos based on a
recurrent encoder-decoder network model. Our proposed model predicts 2D facial
point heat maps regularized by both detection and regression loss, while
uniquely exploiting recurrent learning at both spatial and temporal dimensions.
At the spatial level, we add a feedback loop connection between the combined
output response map and the input, in order to enable iterative coarse-to-fine
face alignment using a single network model, instead of relying on traditional
cascaded model ensembles. At the temporal level, we first decouple the features
in the bottleneck of the network into temporal-variant factors, such as pose
and expression, and temporal-invariant factors, such as identity information.
Temporal recurrent learning is then applied to the decoupled temporal-variant
features. We show that such feature disentangling yields better generalization
and significantly more accurate results at test time. We perform a
comprehensive experimental analysis, showing the importance of each component
of our proposed model, as well as superior results over the state of the art
and several variations of our method in standard datasets.

本论文提出了一种基于循环编码器 - 解码器网络模型的实时视频人脸对齐方法，该方法预测由检测和回归损失正则化的 2D 人脸关键点热力图，同时在空间和时间维度上独特地利用循环学习。在空间上，我们通过输出响应图和输入之间的反馈环连接，使单个网络模型实现迭代粗略到精细的人脸对齐，而不是依赖于传统的级联模型集成。在时间上，我们首先将网络瓶颈中的特征解耦为时变因素和时不变因素，例如姿态和表情和身份信息。然后应用于解耦的时变特征上的时态循环学习。我们展示了这种特征解耦产生更好的泛化效果，在标准数据集上优于现有技术和本方法的几种变体的全面实验分析。