Recovering photorealistic and drivable full-body avatars is crucial for
numerous applications, including virtual reality, 3D games, and tele-presence.
Most methods, whether reconstruction or generation, require large numbers of
human motion sequences and corresponding textured meshes. To easily learn a
drivable avatar, a reasonable parametric body model with unified topology is
paramount. However, existing human body datasets either have images or textured
models and lack parametric models which fit clothes well. We propose a new
parametric model SMPLX-Lite-D, which can fit detailed geometry of the scanned
mesh while maintaining stable geometry in the face, hand and foot regions. We
present SMPLX-Lite dataset, the most comprehensive clothing avatar dataset with
multi-view RGB sequences, keypoints annotations, textured scanned meshes, and
textured SMPLX-Lite-D models. With the SMPLX-Lite dataset, we train a
conditional variational autoencoder model that takes human pose and facial
keypoints as input, and generates a photorealistic drivable human avatar.

提出了一种新的参数化模型 SMPLX-Lite-D，可以适应扫描网格的详细几何结构，同时保持脸部、手部和脚部区域的稳定几何结构。利用 SMPLX-Lite 数据集，训练了一个条件变分自编码器模型，以人体姿势和面部关键点作为输入，生成逼真的可驾驶人体化身。