Shapley values have become one of the most popular feature attribution
explanation methods. However, most prior work has focused on post-hoc Shapley
explanations, which can be computationally demanding due to its exponential
time complexity and preclude model regularization based on Shapley explanations
during training. Thus, we propose to incorporate Shapley values themselves as
latent representations in deep models thereby making Shapley explanations
first-class citizens in the modeling paradigm. This intrinsic explanation
approach enables layer-wise explanations, explanation regularization of the
model during training, and fast explanation computation at test time. We define
the Shapley transform that transforms the input into a Shapley representation
given a specific function. We operationalize the Shapley transform as a neural
network module and construct both shallow and deep networks, called ShapNets,
by composing Shapley modules. We prove that our Shallow ShapNets compute the
exact Shapley values and our Deep ShapNets maintain the missingness and
accuracy properties of Shapley values. We demonstrate on synthetic and
real-world datasets that our ShapNets enable layer-wise Shapley explanations,
novel Shapley regularizations during training, and fast computation while
maintaining reasonable performance. Code is available at
this https URL

本文提出使用 Shapley values 作为深度模型的潜在表示，使得 Shapley explanations 能够成为建模范式的第一等公民，从而实现了层次化解释、模型在训练期间的解释以及快速解释计算。作者证明了 ShapNets 确保 Shapley 值的缺失和准确性，并通过在合成和真实数据集上的演示展示了它的有效性。