Uncertainty estimation of the trained deep learning network provides important information for improving the learning efficiency or evaluating the reliability of the network prediction. In this paper, we propose a method for the uncertainty estimation for multi-class image classification using test-time mixup augmentation (TTMA). To improve the discrimination ability between the correct and incorrect prediction of the existing aleatoric uncertainty, we propose the data uncertainty by applying the mixup augmentation on the test data and measuring the entropy of the histogram of predicted labels. In addition to the data uncertainty, we propose a class-specific uncertainty presenting the aleatoric uncertainty associated with the specific class, which can provide information on the class confusion and class similarity of the trained network. The proposed methods are validated on two public datasets, the ISIC-18 skin lesion diagnosis dataset, and the CIFAR-100 real-world image classification dataset. The experiments demonstrate that (1) the proposed data uncertainty better separates the correct and incorrect prediction than the existing uncertainty measures thanks to the mixup perturbation, and (2) the proposed class-specific uncertainty provides information on the class confusion and class similarity of the trained network for both datasets.

本文提出了一种通过测试时混合数据增强方法（TTMA）来进行深度学习图像分类不确定性估计的方法。基于混合增强方法，我们引入了TTMA数据不确定性（TTMA-DU）和TTMA类别相关不确定性（TTMA-CDU），分别可以提供更加准确的不确定性估计和深入的数据分析，通过在ISIC-18和CIFAR-100数据集上的实验验证了所提出方法的有效性。

深度学习图像分类中的数据与类别相关不确定性估计的测试时间混合增强方法