We present a box-free bottom-up approach for the tasks of pose estimation and
instance segmentation of people in multi-person images using an efficient
single-shot model. The proposed PersonLab model tackles both semantic-level
reasoning and object-part associations using part-based modeling. Our model
employs a convolutional network which learns to detect individual keypoints and
predict their relative displacements, allowing us to group keypoints into
person pose instances. Further, we propose a part-induced geometric embedding
descriptor which allows us to associate semantic person pixels with their
corresponding person instance, delivering instance-level person segmentations.
Our system is based on a fully-convolutional architecture and allows for
efficient inference, with runtime essentially independent of the number of
people present in the scene. Trained on COCO data alone, our system achieves
COCO test-dev keypoint average precision of 0.665 using single-scale inference
and 0.687 using multi-scale inference, significantly outperforming all previous
bottom-up pose estimation systems. We are also the first bottom-up method to
report competitive results for the person class in the COCO instance
segmentation task, achieving a person category average precision of 0.417.

提出一种基于部件建模的无框架底层算法，将姿态估计和多人图像实例分割任务结合起来，使用卷积神经网络检测关键点并预测其相对位移，允许将关键点分组为个人姿势实例，并提出一种部分诱导的几何嵌入描述符。此系统基于完全卷积架构，具有高效的推理能力，在 COCO 数据集上进行训练，实现了显着的性能优化，是首个在 COCO 实例分割任务中策略人类一类的结果。