Due to the emergence of Generative Adversarial Networks, video synthesis has
witnessed exceptional breakthroughs. However, existing methods lack a proper
representation to explicitly control the dynamics in videos. Human pose, on the
other hand, can represent motion patterns intrinsically and interpretably, and
impose the geometric constraints regardless of appearance. In this paper, we
propose a pose guided method to synthesize human videos in a disentangled way:
plausible motion prediction and coherent appearance generation. In the first
stage, a Pose Sequence Generative Adversarial Network (PSGAN) learns in an
adversarial manner to yield pose sequences conditioned on the class label. In
the second stage, a Semantic Consistent Generative Adversarial Network (SCGAN)
generates video frames from the poses while preserving coherent appearances in
the input image. By enforcing semantic consistency between the generated and
ground-truth poses at a high feature level, our SCGAN is robust to noisy or
abnormal poses. Extensive experiments on both human action and human face
datasets manifest the superiority of the proposed method over other
state-of-the-arts.

本文提出了一种基于姿态引导的方法来以可分离的方式合成人类视频：可信的运动预测和协调的外观生成，旨在探索并掌握视频合成中人体姿态的本质动态和诠释能力，并在保持外观连贯性的同时处理异常和嘈杂数据，实验证明其优于现有技术。