We propose a novel self-supervised framework for retargeting
non-parameterized 3D garments onto 3D human avatars of arbitrary shapes and
poses, enabling 3D virtual try-on (VTON). Existing self-supervised 3D
retargeting methods only support parametric and canonical garments, which can
only be draped over parametric body, e.g. SMPL. To facilitate the
non-parametric garments and body, we propose a novel method that introduces
Isomap Embedding based correspondences matching between the garment and the
human body to get a coarse alignment between the two meshes. We perform neural
refinement of the coarse alignment in a self-supervised setting. Further, we
leverage a Laplacian detail integration method for preserving the inherent
details of the input garment. For evaluating our 3D non-parametric garment
retargeting framework, we propose a dataset of 255 real-world garments with
realistic noise and topological deformations. The dataset contains $44$ unique
garments worn by 15 different subjects in 5 distinctive poses, captured using a
multi-view RGBD capture setup. We show superior retargeting quality on
non-parametric garments and human avatars over existing state-of-the-art
methods, acting as the first-ever baseline on the proposed dataset for
non-parametric 3D garment retargeting.

我们提出了一种新颖的自监督框架，用于在任意形状和姿势的三维人体化身上重定向非参数化的三维服装，实现三维虚拟试穿。我们引入了基于 Isomap 嵌入的对应匹配方法，以获得两个网格之间的粗略对齐，并在自监督环境下进行精细对齐的神经改进。此外，我们利用 Laplacian 细节整合方法来保留输入服装的内在细节，通过使用包含 255 种真实噪声和拓扑变形的真实世界服装数据集来评估我们的三维非参数化服装重定向框架，并展示了其在非参数化服装和人体化身上优于现有最先进方法的重定向质量，在该数据集上作为非参数化三维服装重定向的首个基准。

Dress-Me-Up: 一个用于自监督三维服装再定位的数据集和方法

Dress-Me-Up: A Dataset & Method for Self-Supervised 3D Garment  Retargeting

3D virtual try-on enjoys many potential applications and hence has attracted
wide attention. However, it remains a challenging task that has not been
adequately solved. Existing 2D virtual try-on methods cannot be directly
extended to 3D since they lack the ability to perceive the depth of each pixel.
Besides, 3D virtual try-on approaches are mostly built on the fixed topological
structure and with heavy computation. To deal with these problems, we propose a
Decomposed Implicit garment transfer network (DI-Net), which can effortlessly
reconstruct a 3D human mesh with the newly try-on result and preserve the
texture from an arbitrary perspective. Specifically, DI-Net consists of two
modules: 1) A complementary warping module that warps the reference image to
have the same pose as the source image through dense correspondence learning
and sparse flow learning; 2) A geometry-aware decomposed transfer module that
decomposes the garment transfer into image layout based transfer and texture
based transfer, achieving surface and texture reconstruction by constructing
pixel-aligned implicit functions. Experimental results show the effectiveness
and superiority of our method in the 3D virtual try-on task, which can yield
more high-quality results over other existing methods.

3D 虚拟试穿是一个具有广泛潜力且备受关注的挑战性任务，本文提出了一种基于分解的隐式服装转换网络 (DI-Net)，通过像素对齐的隐式函数构建方法，实现了从任意视角重建 3D 人体网格和保留其纹理恢复的能力，在 3D 虚拟试穿任务中展现出优异的性能和效果。