Decision processes of computer vision models - especially deep neural
networks - are opaque in nature, meaning that these decisions cannot be
understood by humans. Thus, over the last years, many methods to provide
human-understandable explanations have been proposed. For image classification,
the most common group are saliency methods, which provide (super-)pixelwise
feature attribution scores for input images. But their evaluation still poses a
problem, as their results cannot be simply compared to the unknown ground
truth. To overcome this, a slew of different proxy metrics have been defined,
which are - as the explainability methods themselves - often built on intuition
and thus, are possibly unreliable. In this paper, new evaluation metrics for
saliency methods are developed and common saliency methods are benchmarked on
ImageNet. In addition, a scheme for reliability evaluation of such metrics is
proposed that is based on concepts from psychometric testing. The used code can
be found at
this https URL .

计算机视觉模型的决策过程（尤其是深度神经网络）的不透明性意味着这些决策无法被人类理解。因此，在过去几年中，已经提出了许多提供人理解解释的方法。本文针对图像分类开发了新的评估指标，并对常见的显著性方法在 ImageNet 上进行了基准测试。此外，还提出了一种基于心理测评概念的可靠性评估方案。