Generating controllable and photorealistic digital human avatars is a
long-standing and important problem in Vision and Graphics. Recent methods have
shown great progress in terms of either photorealism or inference speed while
the combination of the two desired properties still remains unsolved. To this
end, we propose a novel method, called DELIFFAS, which parameterizes the
appearance of the human as a surface light field that is attached to a
controllable and deforming human mesh model. At the core, we represent the
light field around the human with a deformable two-surface parameterization,
which enables fast and accurate inference of the human appearance. This allows
perceptual supervision on the full image compared to previous approaches that
could only supervise individual pixels or small patches due to their slow
runtime. Our carefully designed human representation and supervision strategy
leads to state-of-the-art synthesis results and inference time. The video
results and code are available at
this https URL

生成可控且逼真的数字人类化身一直以来都是计算机视觉和图形学中一个重要而又长期存在的问题。最近的方法在逼真度或推理速度方面取得了巨大的进展，但是这两个属性的组合仍然没有解决。为此，我们提出了一种新的方法，称为 DELIFFAS，它将人的外观参数化为一个附加在可控且可变形的人体网格模型上的表面光场。核心是通过可变形的二层面参数化来表示人体周围的光场，这使得对人的外观进行快速准确的推理成为可能。相较于过去只能对单个像素或小块进行监督的方法，这种方法允许在完整图像上进行感知监督，而且具备运行时间快的特点。我们精心设计的人体表达方式和监督策略带来了最新的合成结果和推理时间。视频结果和代码可以在此 https URL 中找到。

DELIFFAS: 快速化身综合的可变形光场

DELIFFAS: Deformable Light Fields for Fast Avatar Synthesis

This paper investigates different approaches to build and use digital human
avatars toward interactive Virtual Co-presence (VCP) environments. We evaluate
the evolution of technologies for creating VCP environments and how the
advancement in Artificial Intelligence (AI) and Computer Graphics affect the
quality of VCP environments. We categorize different methods in the literature
based on their applications and methodology and compare various groups and
strategies based on their applications, contributions, and limitations. We also
have a brief discussion about the approaches that other forms of human
representation, rather than digital human avatars, have been utilized in VCP
environments. Our goal is to fill the gap in the research domain where there is
a lack of literature review investigating different approaches for creating
avatar-based VCP environments. We hope this study will be useful for future
research involving human representation in VCP or Virtual Reality (VR)
environments. To the best of our knowledge, it is the first survey research
that investigates avatar-based VCP environments. Specifically, the
categorization methodology suggested in this paper for avatar-based methods is
new.

本文调查了构建和使用数字人类化身的不同方法并研究它们对交互式虚拟共存 (VCP) 环境的影响，我们基于应用程序和方法学对文献中的不同方法进行分类，并根据其应用，贡献和限制比较不同的组和策略。此外还讨论了除数字人类化身以外的其他类似方法在 VCP 环境中的应用。本研究的目标是填补研究领域中的空白，提供有关创建基于化身的 VCP 环境的不同方法的文献综述。我们希望这项研究对未来涉及人类在 VCP 或虚拟现实 (VR) 环境中表示的研究有用。据我们所知，这是第一项调查数字人类化身的 VCP 环境的研究，并提出了一种新的分类方法。