We present a simple yet effective method to infer detailed full human body
shape from only a single photograph. Our model can infer full-body shape
including face, hair, and clothing including wrinkles at interactive
frame-rates. Results feature details even on parts that are occluded in the
input image. Our main idea is to turn shape regression into an aligned
image-to-image translation problem. The input to our method is a partial
texture map of the visible region obtained from off-the-shelf methods. From a
partial texture, we estimate detailed normal and vector displacement maps,
which can be applied to a low-resolution smooth body model to add detail and
clothing. Despite being trained purely with synthetic data, our model
generalizes well to real-world photographs. Numerous results demonstrate the
versatility and robustness of our method.

本研究提出了从单张照片推断出详细的全身人体形状的简单而有效的方法，其将形状回归转化为图像转换问题，并使用纹理图来估计细节的法线和位移图，能够将细节添加到低分辨率的光滑身体模型中，尽管仅使用合成数据进行训练，但该模型在真实世界的照片上表现良好。

Tex2Shape：从单张图像获取详细的全身人体几何形状

Tex2Shape: Detailed Full Human Body Geometry From a Single Image

Most recent garment capturing techniques rely on acquiring multiple views of
clothing, which may not always be readily available, especially in the case of
pre-existing photographs from the web. As an alternative, we pro- pose a method
that is able to compute a rich and realistic 3D model of a human body and its
outfits from a single photograph with little human in- teraction. Our algorithm
is not only able to capture the global shape and geometry of the clothing, it
can also extract small but important details of cloth, such as occluded
wrinkles and folds. Unlike previous methods using full 3D information (i.e.
depth, multi-view images, or sampled 3D geom- etry), our approach achieves
detailed garment recovery from a single-view image by using statistical,
geometric, and physical priors and a combina- tion of parameter estimation,
semantic parsing, shape recovery, and physics- based cloth simulation. We
demonstrate the effectiveness of our algorithm by re-purposing the
reconstructed garments for virtual try-on and garment transfer applications, as
well as cloth animation for digital characters.

本研究提出了一种从单张照片中生成人体服装真实 3D 模型的算法，该算法可以还原出服装的全局形态、几何信息和细节，结合参数估计、语义分析和物理模拟等技术，可应用于虚拟试穿、服装转化、数字人物的服装动画等领域。