Unsupervised domain adaptation has attracted growing research attention on
semantic segmentation. However, 1) most existing models cannot be directly
applied into lesions transfer of medical images, due to the diverse appearances
of same lesion among different datasets; 2) equal attention has been paid into
all semantic representations instead of neglecting irrelevant knowledge, which
leads to negative transfer of untransferable knowledge. To address these
challenges, we develop a new unsupervised semantic transfer model including two
complementary modules (i.e., T_D and T_F ) for endoscopic lesions segmentation,
which can alternatively determine where and how to explore transferable
domain-invariant knowledge between labeled source lesions dataset (e.g.,
gastroscope) and unlabeled target diseases dataset (e.g., enteroscopy).
Specifically, T_D focuses on where to translate transferable visual information
of medical lesions via residual transferability-aware bottleneck, while
neglecting untransferable visual characterizations. Furthermore, T_F highlights
how to augment transferable semantic features of various lesions and
automatically ignore untransferable representations, which explores
domain-invariant knowledge and in return improves the performance of T_D. To
the end, theoretical analysis and extensive experiments on medical endoscopic
dataset and several non-medical public datasets well demonstrate the
superiority of our proposed model.

我们提出了一个新的无监督语义转移模型，包括两个互补模块（T_D 和 T_F），针对内窥镜病变分割，其可确定在标记源病变数据集（例如，胃镜）和未标记的目标疾病数据集（例如，肠镜）之间如何和何时探索可转移领域不变知识。