Single image shadow detection is a very challenging problem because of the limited amount of information available in one image, as well as the scarcity of annotated training data. In this work, we propose a novel adversarial training based framework that yields a high performance shadow detection network (D-Net). D-Net is trained together with an Attenuator network (A-Net) that generates adversarial training examples. A-Net performs shadow attenuation in original training images constrained by a simplified physical shadow model and focused on fooling D-Net's shadow predictions. Hence, it is effectively augmenting the training data for D-Net with hard to predict cases. Experimental results on the most challenging shadow detection benchmark show that our method outperforms the state-of-the-art with a 38% error reduction, measured in terms of balanced error rate (BER). Our proposed shadow detector also obtains state-of-the-art results on a cross-dataset task testing on UCF with a 14% error reduction. Furthermore, the proposed method can perform accurate close to real-time shadow detection at a rate of 13 frames per second.

本文提出了一种基于GAN的新型框架，用于在图像中检测阴影，其中训练了一个阴影检测网络（D-Net）以及一个生成对抗训练样例的阴影衰减网络（A-Net），该方法显著提高了D-Net对阴影检测的准确性，并且实时检测效果良好。

A+D网络：使用对抗阴影衰减训练阴影探测器