Rain removal aims to remove rain streaks from images/videos and reduce the
disruptive effects caused by rain. It not only enhances image/video visibility
but also allows many computer vision algorithms to function properly. This
paper makes the first attempt to conduct a comprehensive study on the
robustness of deep learning-based rain removal methods against adversarial
attacks. Our study shows that, when the image/video is highly degraded, rain
removal methods are more vulnerable to the adversarial attacks as small
distortions/perturbations become less noticeable or detectable. In this paper,
we first present a comprehensive empirical evaluation of various methods at
different levels of attacks and with various losses/targets to generate the
perturbations from the perspective of human perception and machine analysis
tasks. A systematic evaluation of key modules in existing methods is performed
in terms of their robustness against adversarial attacks. From the insights of
our analysis, we construct a more robust deraining method by integrating these
effective modules. Finally, we examine various types of adversarial attacks
that are specific to deraining problems and their effects on both human and
machine vision tasks, including 1) rain region attacks, adding perturbations
only in the rain regions to make the perturbations in the attacked rain images
less visible; 2) object-sensitive attacks, adding perturbations only in regions
near the given objects. Code is available at
this https URL

本文针对强降雨情况下图像和视频的降雨除去问题进行了深入研究，发现深度学习技术的降雨去除方法更容易受到针对性的对抗攻击，因此本文综合比较了不同深度学习算法在人类感知和机器分析任务下的降雨去除效果及其对于对抗攻击的鲁棒性。除此之外，本文还结合审核结果构建了一种更加鲁棒的降雨除去技术，同时还对各类面向降雨除去问题的对抗攻击及其对于人类和机器视觉任务的影响进行了分析，并提供了可供使用的代码。