Domain adaptation aims to learn a transferable model to bridge the domain
shift between one labeled source domain and another sparsely labeled or
unlabeled target domain. Since the labeled data may be collected from multiple
sources, multi-source domain adaptation (MDA) has attracted increasing
attention. Recent MDA methods do not consider the pixel-level alignment between
sources and target or the misalignment across different sources. In this paper,
we propose a novel MDA framework to address these challenges. Specifically, we
design an end-to-end Multi-source Adversarial Domain Aggregation Network
(MADAN). First, an adapted domain is generated for each source with dynamic
semantic consistency while aligning towards the target at the pixel-level
cycle-consistently. Second, sub-domain aggregation discriminator and
cross-domain cycle discriminator are proposed to make different adapted domains
more closely aggregated. Finally, feature-level alignment is performed between
the aggregated domain and the target domain while training the task network.
For the segmentation adaptation, we further enforce category-level alignment
and incorporate context-aware generation, which constitutes MADAN+. We conduct
extensive MDA experiments on digit recognition, object classification, and
simulation-to-real semantic segmentation. The results demonstrate that the
proposed MADAN and MANDA+ models outperform state-of-the-art approaches by a
large margin.

本文提出一种新的多源领域自适应 (MDA) 框架，通过设计一个端到端的多源对抗性域聚合网络 (MADAN) 来解决领域自适应中的像素级对齐和任务特征不对齐等挑战，并通过在数字识别、对象分类和模拟到真实语义分割等领域进行广泛的实验，证明 MADAN 和 MANDA + 模型的优越性。