Domain adaptation for semantic segmentation across datasets consisting of the same categories has seen several recent successes. However, a more general scenario is when the source and target datasets correspond to non-overlapping label spaces. For example, categories in segmentation datasets change vastly depending on the type of environment or application, yet share many valuable semantic relations. Existing approaches based on feature alignment or discrepancy minimization do not take such category shift into account. In this work, we present Cluster-to-Adapt (C2A), a computationally efficient clustering-based approach for domain adaptation across segmentation datasets with completely different, but possibly related categories. We show that such a clustering objective enforced in a transformed feature space serves to automatically select categories across source and target domains that can be aligned for improving the target performance, while preventing negative transfer for unrelated categories. We demonstrate the effectiveness of our approach through experiments on the challenging problem of outdoor to indoor adaptation for semantic segmentation in few-shot as well as zero-shot settings, with consistent improvements in performance over existing approaches and baselines in all cases.

本研究提出了一种聚类适配方法Cluster-to-Adapt（C2A），通过在转换的特征空间中强制执行聚类目标来选择源和目标域之间可以对齐的类别，从而实现分割数据集领域自适应的跨数据集分类适应。该方法在室内外语境场景下进行的少样本学习和零样本学习中均表现出了比现有方法和基准方法都更好的性能。

聚类到适应：在不同标签之间进行语义分割的少样本领域自适应