In this paper, we propose a novel learning approach for feed-forward one-shot
4D head avatar synthesis. Different from existing methods that often learn from
reconstructing monocular videos guided by 3DMM, we employ pseudo multi-view
videos to learn a 4D head synthesizer in a data-driven manner, avoiding
reliance on inaccurate 3DMM reconstruction that could be detrimental to the
synthesis performance. The key idea is to first learn a 3D head synthesizer
using synthetic multi-view images to convert monocular real videos into
multi-view ones, and then utilize the pseudo multi-view videos to learn a 4D
head synthesizer via cross-view self-reenactment. By leveraging a simple vision
transformer backbone with motion-aware cross-attentions, our method exhibits
superior performance compared to previous methods in terms of reconstruction
fidelity, geometry consistency, and motion control accuracy. We hope our method
offers novel insights into integrating 3D priors with 2D supervisions for
improved 4D head avatar creation.

通过使用伪多视图视频，我们提出了一种新颖的学习方法，用于前馈一次性 4D 头像合成，并利用运动感知交叉注意力的简单视觉转换器骨干，我们的方法在重建保真度、几何一致性和运动控制精度方面具有优于先前方法的性能。