The focus of recent research has shifted from merely increasing the Deep
Neural Networks (DNNs) performance in various tasks to DNNs, which are more
interpretable to humans. The field of eXplainable Artificial Intelligence (XAI)
has observed various techniques, including saliency-based and concept-based
approaches. Concept-based approaches explain the model's decisions in simple
human understandable terms called Concepts. Concepts are human interpretable
units of data and are the thinking ground of humans. Explanations in terms of
concepts enable detecting spurious correlations, inherent biases, or
clever-hans. With the advent of concept-based explanations, there have been
various concept representation methods and automatic concept discovery
algorithms. Some recent methods use concepts for post-hoc model disentanglement
evaluation, while others use them for ante-hoc training. The concept-based
approaches are new, with many representations coming up, and there is very
limited work on Concept-based Model improvement. We provide a systematic review
and taxonomy of various concept representations and their discovery algorithms
in DNNs, specifically in vision. We also provide details on concept-based model
improvement literature, which is the first to survey concept-based model
improvement methods.

最近的研究关注点已经从简单地提高深度神经网络（DNNs）在各种任务中的性能转向了更具人可解释性的 DNNs。人工智能解释性领域已经观察到了包括基于显著性和基于概念的技术。概念是人类可理解的数据单元，是人类思考的基础。本文系统地回顾和分类了 DNNs 中各种概念表示及其发现算法，特别是在视觉领域。同时也提供了关于基于概念的模型改进文献的详细信息，这是第一个调查基于概念的模型改进方法的研究。