Semantic scene parsing is suffering from the fact that pixel-level
annotations are hard to be collected. To tackle this issue, we propose a
Point-based Distance Metric Learning (PDML) in this paper. PDML does not
require dense annotated masks and only leverages several labeled points that
are much easier to obtain to guide the training process. Concretely, we
leverage semantic relationship among the annotated points by encouraging the
feature representations of the intra- and inter-category points to keep
consistent, i.e. points within the same category should have more similar
feature representations compared to those from different categories. We
formulate such a characteristic into a simple distance metric loss, which
collaborates with the point-wise cross-entropy loss to optimize the deep neural
networks. Furthermore, to fully exploit the limited annotations, distance
metric learning is conducted across different training images instead of simply
adopting an image-dependent manner. We conduct extensive experiments on two
challenging scene parsing benchmarks of PASCAL-Context and ADE 20K to validate
the effectiveness of our PDML, and competitive mIoU scores are achieved.

本文提出一种基于点的距离度量学习（PDML）方法，通过鼓励标注点之间的特征保持一致来引导训练过程，使用限定的标注点代替密集标注 mask 进行语义场景解析，最终在 PASCAL-Context 和 ADE 20K 数据集上实验验证结果表明 PDML 方法有效性较高。