Invariance to a broad array of image corruptions, such as warping, noise, or
color shifts, is an important aspect of building robust models in computer
vision. Recently, several new data augmentations have been proposed that
significantly improve performance on ImageNet-C, a benchmark of such
corruptions. However, there is still a lack of basic understanding on the
relationship between data augmentations and test-time corruptions. To this end,
we develop a feature space for image transforms, and then use a new measure in
this space between augmentations and corruptions called the Minimal Sample
Distance to demonstrate a strong correlation between similarity and
performance. We then investigate recent data augmentations and observe a
significant degradation in corruption robustness when the test-time corruptions
are sampled to be perceptually dissimilar from ImageNet-C in this feature
space. Our results suggest that test error can be improved by training on
perceptually similar augmentations, and data augmentations may not generalize
well beyond the existing benchmark. We hope our results and tools will allow
for more robust progress towards improving robustness to image corruptions. We
provide code at this https URL

本文利用最小样本距离等方法，探究了数据增强和测试时图像扭曲之间的关系，并提出了测试时图像扭曲和数据增强之间的感知相似度的概念。结果表明，基于感知相似的数据增强可以提高对图像扭曲的鲁棒性，并强调数据增强在图像扭曲鲁棒性方面的重要性。