3D instance segmentation, with a variety of applications in robotics and
augmented reality, is in large demands these days. Unlike 2D images that are
projective observations of the environment, 3D models provide metric
reconstruction of the scenes without occlusion or scale ambiguity. In this
paper, we define "3D occupancy size", as the number of voxels occupied by each
instance. It owns advantages of robustness in prediction, on which basis,
OccuSeg, an occupancy-aware 3D instance segmentation scheme is proposed. Our
multi-task learning produces both occupancy signal and embedding
representations, where the training of spatial and feature embeddings varies
with their difference in scale-aware. Our clustering scheme benefits from the
reliable comparison between the predicted occupancy size and the clustered
occupancy size, which encourages hard samples being correctly clustered and
avoids over segmentation. The proposed approach achieves state-of-the-art
performance on 3 real-world datasets, i.e. ScanNetV2, S3DIS and SceneNN, while
maintaining high efficiency.

本文介绍了 3D 实例分割中使用的 Occupancy Size 作为度量标准，以增强性能，并提出了一种基于 Occupancy Size 的 OccuSeg 实例分割方法，其利用多任务学习产生了占用信号和嵌入表示，并使用聚类方案鼓励正确聚类难样本，避免过度分割，是目前在 ScanNetV2、S3DIS 和 SceneNN 等 3 个真实数据集上表现最优秀的方法。