Human-object contact serves as a strong cue to understand how humans
physically interact with objects. Nevertheless, it is not widely explored to
utilize human-object contact information for the joint reconstruction of 3D
human and object from a single image. In this work, we present a novel joint 3D
human-object reconstruction method (CONTHO) that effectively exploits contact
information between humans and objects. There are two core designs in our
system: 1) 3D-guided contact estimation and 2) contact-based 3D human and
object refinement. First, for accurate human-object contact estimation, CONTHO
initially reconstructs 3D humans and objects and utilizes them as explicit 3D
guidance for contact estimation. Second, to refine the initial reconstructions
of 3D human and object, we propose a novel contact-based refinement Transformer
that effectively aggregates human features and object features based on the
estimated human-object contact. The proposed contact-based refinement prevents
the learning of erroneous correlation between human and object, which enables
accurate 3D reconstruction. As a result, our CONTHO achieves state-of-the-art
performance in both human-object contact estimation and joint reconstruction of
3D human and object. The code is publicly available at
this https URL

该研究提出了一种利用人 - 物接触信息进行三维人体与物体联合重建的新方法 (CONTHO)，通过 3D 引导接触估计和基于接触的三维人体与物体细化，实现了更准确的重建，取得了最先进的性能。