In this paper we present a novel approach for bottom-up multi-person 3D human
pose estimation from monocular RGB images. We propose to use high resolution
volumetric heatmaps to model joint locations, devising a simple and effective
compression method to drastically reduce the size of this representation. At
the core of the proposed method lies our Volumetric Heatmap Autoencoder, a
fully-convolutional network tasked with the compression of ground-truth
heatmaps into a dense intermediate representation. A second model, the Code
Predictor, is then trained to predict these codes, which can be decompressed at
test time to re-obtain the original representation. Our experimental evaluation
shows that our method performs favorably when compared to state of the art on
both multi-person and single-person 3D human pose estimation datasets and,
thanks to our novel compression strategy, can process full-HD images at the
constant runtime of 8 fps regardless of the number of subjects in the scene.
Code and models available at this https URL .

本文提出了一种基于多层热力图压缩的深度学习模型，可在 8 fps 的运行时处理全高清 RGB 图像，用于多人和单人 3D 人体姿态估计。

多人三维姿态估计的压缩体积热力图

Compressed Volumetric Heatmaps for Multi-Person 3D Pose Estimation

Heatmap representations have formed the basis of 2D human pose estimation
systems for many years, but their generalizations for 3D pose have only
recently been considered. This includes 2.5D volumetric heatmaps, whose X and Y
axes correspond to image space and the Z axis to metric depth around the
subject. To obtain metric-scale predictions, these methods must include a
separate, explicit post-processing step to resolve scale ambiguity. Further,
they cannot encode body joint positions outside of the image boundaries,
leading to incomplete pose estimates in case of image truncation. We address
these limitations by proposing metric-scale truncation-robust (MeTRo)
volumetric heatmaps, whose dimensions are defined in metric 3D space near the
subject, instead of being aligned with image space. We train a
fully-convolutional network to estimate such heatmaps from monocular RGB in an
end-to-end manner. This reinterpretation of the heatmap dimensions allows us to
estimate complete metric-scale poses without test-time knowledge of the focal
length or person distance and without relying on anthropometric heuristics in
post-processing. Furthermore, as the image space is decoupled from the heatmap
space, the network can learn to reason about joints beyond the image boundary.
Using ResNet-50 without any additional learned layers, we obtain
state-of-the-art results on the Human3.6M and MPI-INF-3DHP benchmarks. As our
method is simple and fast, it can become a useful component for real-time
top-down multi-person pose estimation systems. We make our code publicly
available to facilitate further research (see
this https URL).

本研究中，我们提出了一种度量尺度的截断鲁棒体素热力图，该热力图的维度定义在靠近主体的度量 3D 空间中，使我们能够在没有测试时间知识的情况下估计完整的度量尺度姿势，同时优于现有人体姿势估计标准，具有实时性。