Automatic perception of human behaviors during social interactions is crucial
for AR/VR applications, and an essential component is estimation of plausible
3D human pose and shape of our social partners from the egocentric view. One of
the biggest challenges of this task is severe body truncation due to close
social distances in egocentric scenarios, which brings large pose ambiguities
for unseen body parts. To tackle this challenge, we propose a novel
scene-conditioned diffusion method to model the body pose distribution.
Conditioned on the 3D scene geometry, the diffusion model generates bodies in
plausible human-scene interactions, with the sampling guided by a physics-based
collision score to further resolve human-scene inter-penetrations. The
classifier-free training enables flexible sampling with different conditions
and enhanced diversity. A visibility-aware graph convolution model guided by
per-joint visibility serves as the diffusion denoiser to incorporate
inter-joint dependencies and per-body-part control. Extensive evaluations show
that our method generates bodies in plausible interactions with 3D scenes,
achieving both superior accuracy for visible joints and diversity for invisible
body parts. The code will be available at
this https URL

提出了一种基于场景的扩散方法，用于从自我感知的角度预测社交伴侣的姿态和形状，通过物理学基础碰撞评分进一步解决人 - 场景相互渗透，分类器自由训练使得在不同情况下可进行可扩展抽样，并具有更多的多样性，能够通过基于每个关节的可见性进行噪声去除，控制每个身体部位，实现了优秀的可见关节准确度和不可见身体部位的多样性。