We introduce InverseFaceNet, a deep convolutional inverse rendering framework
for faces that jointly estimates facial pose, shape, expression, reflectance
and illumination from a single input image. By estimating all parameters from
just a single image, advanced editing possibilities on a single face image,
such as appearance editing and relighting, become feasible in real time. Most
previous learning-based face reconstruction approaches do not jointly recover
all dimensions, or are severely limited in terms of visual quality. In
contrast, we propose to recover high-quality facial pose, shape, expression,
reflectance and illumination using a deep neural network that is trained using
a large, synthetically created training corpus. Our approach builds on a novel
loss function that measures model-space similarity directly in parameter space
and significantly improves reconstruction accuracy. We further propose a
self-supervised bootstrapping process in the network training loop, which
iteratively updates the synthetic training corpus to better reflect the
distribution of real-world imagery. We demonstrate that this strategy
outperforms completely synthetically trained networks. Finally, we show
high-quality reconstructions and compare our approach to several
state-of-the-art approaches.

InverseFaceNet 是一种基于深度卷积反渲染框架的新方法，可以实时地从单个输入图像中同时估计人脸的姿态、形状、表情、反射和照明，通过利用深度神经网络训练，结合实时的外观编辑和重新照明等高级处理技术，实现了高质量、高度还原的人脸重建。