Evaluating, explaining, and visualizing high-level concepts in generative
models, such as variational autoencoders (VAEs), is challenging in part due to
a lack of known prediction classes that are required to generate saliency maps
in supervised learning. While saliency maps may help identify relevant features
(e.g., pixels) in the input for classification tasks of deep neural networks,
similar frameworks are understudied in unsupervised learning. Therefore, we
introduce a new method of obtaining saliency maps for latent representations of
known or novel high-level concepts, often called concept vectors in generative
models. Concept scores, analogous to class scores in classification tasks, are
defined as dot products between concept vectors and encoded input data, which
can be readily used to compute the gradients. The resulting concept saliency
maps are shown to highlight input features deemed important for high-level
concepts. Our method is applied to the VAE's latent space of CelebA dataset in
which known attributes such as "smiles" and "hats" are used to elucidate
relevant facial features. Furthermore, our application to spatial
transcriptomic (ST) data of a mouse olfactory bulb demonstrates the potential
of latent representations of morphological layers and molecular features in
advancing our understanding of complex biological systems. By extending the
popular method of saliency maps to generative models, the proposed concept
saliency maps help improve interpretability of latent variable models in deep
learning.
Codes to reproduce and to implement concept saliency maps:
this https URL

提出了一种新的方法来获得生成模型中已知或新的高级概念的显著性图，即概念显著性图，对于深度学习中的潜在变量模型提高了解释性。该方法被应用于 CelebA 数据集的 VAE 潜在空间中和小鼠嗅球的空间转录组数据中，证明了其在高级概念的解释和复杂生物系统理解中的潜力。