In this paper, we propose a conceptually novel, efficient, and fully
convolutional framework for real-time instance segmentation. Previously, most
instance segmentation methods heavily rely on object detection and perform mask
prediction based on bounding boxes or dense centers. In contrast, we propose a
sparse set of instance activation maps, as a new object representation, to
highlight informative regions for each foreground object. Then instance-level
features are obtained by aggregating features according to the highlighted
regions for recognition and segmentation. Moreover, based on bipartite
matching, the instance activation maps can predict objects in a one-to-one
style, thus avoiding non-maximum suppression (NMS) in post-processing. Owing to
the simple yet effective designs with instance activation maps, SparseInst has
extremely fast inference speed and achieves 40 FPS and 37.9 AP on the COCO
benchmark, which significantly outperforms the counterparts in terms of speed
and accuracy. Code and models are available at
this https URL

本文提出了一种实时实例分割的概念性新颖、高效并且完全卷积的框架。该框架采用了一种新的目标表示方法 —— 稀疏的实例激活图，通过聚合特征识别和分割前景对象，在一对一的模式下预测物体，避免后处理中的非极大值抑制。该方法在 COCO 基准测试中实现了 40 FPS 和 37.9 AP，速度和准确性均得到显著提高。