Few-shot segmentation is challenging because objects within the support and
query images could significantly differ in appearance and pose. Using a single
prototype acquired directly from the support image to segment the query image
causes semantic ambiguity. In this paper, we propose prototype mixture models
(PMMs), which correlate diverse image regions with multiple prototypes to
enforce the prototype-based semantic representation. Estimated by an
Expectation-Maximization algorithm, PMMs incorporate rich channel-wised and
spatial semantics from limited support images. Utilized as representations as
well as classifiers, PMMs fully leverage the semantics to activate objects in
the query image while depressing background regions in a duplex manner.
Extensive experiments on Pascal VOC and MS-COCO datasets show that PMMs
significantly improve upon state-of-the-arts. Particularly, PMMs improve 5-shot
segmentation performance on MS-COCO by up to 5.82\% with only a moderate cost
for model size and inference speed.

本文提出了一种原型混合模型 (PMMs)，该模型利用期望最大化算法从有限的支持图像中提取通道和空间语义，从而在激活查询图像中的物体的同时抑制背景区域，这种方法在 MS-COCO 数据集上 5-shot 分割性能提高了 5.82%。