Estimating 3D poses and shapes in the form of meshes from monocular RGB
images is challenging. Obviously, it is more difficult than estimating 3D poses
only in the form of skeletons or heatmaps. When interacting persons are
involved, the 3D mesh reconstruction becomes more challenging due to the
ambiguity introduced by person-to-person occlusions. To tackle the challenges,
we propose a coarse-to-fine pipeline that benefits from 1) inverse kinematics
from the occlusion-robust 3D skeleton estimation and 2) Transformer-based
relation-aware refinement techniques. In our pipeline, we first obtain
occlusion-robust 3D skeletons for multiple persons from an RGB image. Then, we
apply inverse kinematics to convert the estimated skeletons to deformable 3D
mesh parameters. Finally, we apply the Transformer-based mesh refinement that
refines the obtained mesh parameters considering intra- and inter-person
relations of 3D meshes. Via extensive experiments, we demonstrate the
effectiveness of our method, outperforming state-of-the-arts on 3DPW, MuPoTS
and AGORA datasets.

本研究提出了一种粗到细的流程来解决从单眼 RGB 图像中估计多人物 3D 姿态和形状网格的问题，并且通过 Transformer-based refinement 和克服因人与人之间的遮挡而引入的不确定性，优于现有技术，在 3DPW，MuPoTS 和 AGORA 数据集上进行广泛实验得出了实验证明。