Fully convolutional models for dense prediction have proven successful for a wide range of visual tasks. Such models perform well in a supervised setting, but performance can be surprisingly poor under domain shifts that appear mild to a human observer. For example, training on one city and testing on another in a different geographic region and/or weather condition may result in significantly degraded performance due to pixel-level distribution shift. In this paper, we introduce the first domain adaptive semantic segmentation method, proposing an unsupervised adversarial approach to pixel prediction problems. Our method consists of both global and category specific adaptation techniques. Global domain alignment is performed using a novel semantic segmentation network with fully convolutional domain adversarial learning. This initially adapted space then enables category specific adaptation through a generalization of constrained weak learning, with explicit transfer of the spatial layout from the source to the target domains. Our approach outperforms baselines across different settings on multiple large-scale datasets, including adapting across various real city environments, different synthetic sub-domains, from simulated to real environments, and on a novel large-scale dash-cam dataset.

本文介绍的第一种领域自适应语义分割方法，提出了一种针对像素预测问题的无监督对抗方法，该方法包括全局和类别特定的适应技术，它使用具有全卷积领域对抗学习的新型语义分割网络进行全局领域对齐，然后通过弱学习的推广进行类别特定适应，这使得从源域传递到目标域的空间布局的显式转移成为可能，本方法在多个大规模数据集上优于基线方法，包括适应各种真实城市环境、不同合成子域，从模拟到真实环境，并且在一个新的大规模仪表盘相机数据集上也具有很好的表现。

野外中的FCNs:像素级对抗和约束适应