Discriminatively trained neural classifiers can be trusted, only when the
input data comes from the training distribution (in-distribution). Therefore,
detecting out-of-distribution (OOD) samples is very important to avoid
classification errors. In the context of OOD detection for image
classification, one of the recent approaches proposes training a classifier
called "confident-classifier" by minimizing the standard cross-entropy loss on
in-distribution samples and minimizing the KL divergence between the predictive
distribution of OOD samples in the low-density regions of in-distribution and
the uniform distribution (maximizing the entropy of the outputs). Thus, the
samples could be detected as OOD if they have low confidence or high entropy.
In this paper, we analyze this setting both theoretically and experimentally.
We conclude that the resulting confident-classifier still yields arbitrarily
high confidence for OOD samples far away from the in-distribution. We instead
suggest training a classifier by adding an explicit "reject" class for OOD
samples.

本文针对图像分类中的 ODD 问题，分析研究了最近提出的使用置信分类器来检测 ODD 样本的方法，并结论表明该方法仍会对偏离训练数据分布的 OOD 样本产生高置信度，建议新增 “拒绝” 类别来训练分类器。