Existing deep learning-based image deraining methods have achieved promising
performance for synthetic rainy images, typically rely on the pairs of sharp
images and simulated rainy counterparts. However, these methods suffer from
significant performance drop when facing the real rain, because of the huge gap
between the simplified synthetic rain and the complex real rain. In this work,
we argue that the rain generation and removal are the two sides of the same
coin and should be tightly coupled. To close the loop, we propose to jointly
learn real rain generation and removal procedure within a unified disentangled
image translation framework. Specifically, we propose a bidirectional
disentangled translation network, in which each unidirectional network contains
two loops of joint rain generation and removal for both the real and synthetic
rain image, respectively. Meanwhile, we enforce the disentanglement strategy by
decomposing the rainy image into a clean background and rain layer (rain
removal), in order to better preserve the identity background via both the
cycle-consistency loss and adversarial loss, and ease the rain layer
translating between the real and synthetic rainy image. A counterpart
composition with the entanglement strategy is symmetrically applied for rain
generation. Extensive experiments on synthetic and real-world rain datasets
show the superiority of proposed method compared to state-of-the-arts.

本研究探讨深度学习图像去雨方法存在的问题，并提出了一种基于解耦图像转换的雨生成和去除方法，在合成和真实环境的数据集上进行实验并获得了更好的结果。