We propose a new type of full-body human avatars, which combines parametric
mesh-based body model with a neural texture. We show that with the help of
neural textures, such avatars can successfully model clothing and hair, which
usually poses a problem for mesh-based approaches. We also show how these
avatars can be created from multiple frames of a video using backpropagation.
We then propose a generative model for such avatars that can be trained from
datasets of images and videos of people. The generative model allows us to
sample random avatars as well as to create dressed avatars of people from one
or few images. The code for the project is available at
saic-violet.github.io/style-people.

本文提出了一种基于参数化网格人体模型和神经纹理的新型全身人体化身，证明了神经纹理能够成功地建模衣服和头发，并展示了如何使用反向传播从视频的多个框架创建这些化身，进一步提出了一种适用于人体化身的生成模型，能够从人们的图像和视频数据集中进行训练，可以随机生成人体化身以及从一到几张图片中创建穿着着装的人体化身。

StylePeople: 全身人型头像生成模型

StylePeople: A Generative Model of Fullbody Human Avatars

Human re-rendering from a single image is a starkly under-constrained
problem, and state-of-the-art algorithms often exhibit undesired artefacts,
such as over-smoothing, unrealistic distortions of the body parts and garments,
or implausible changes of the texture. To address these challenges, we propose
a new method for neural re-rendering of a human under a novel user-defined pose
and viewpoint, given one input image. Our algorithm represents body pose and
shape as a parametric mesh which can be reconstructed from a single image and
easily reposed. Instead of a colour-based UV texture map, our approach further
employs a learned high-dimensional UV feature map to encode appearance. This
rich implicit representation captures detailed appearance variation across
poses, viewpoints, person identities and clothing styles better than learned
colour texture maps. The body model with the rendered feature maps is fed
through a neural image-translation network that creates the final rendered
colour image. The above components are combined in an end-to-end-trained neural
network architecture that takes as input a source person image, and images of
the parametric body model in the source pose and desired target pose.
Experimental evaluation demonstrates that our approach produces higher quality
single image re-rendering results than existing methods.

该论文提出一种新的神经重渲染方法，利用单张图像生成一个人体在新的用户定义的姿势和视角下的三维重建，并通过高维度 UV 特征图编码外观，该方法在单张图像重渲染方面比现有方法产生更高质量的成果。