Linear approximations to the decision boundary of a complex model have become
one of the most popular tools for interpreting predictions. In this paper, we
study such linear explanations produced either post-hoc by a few recent methods
or generated along with predictions with contextual explanation networks
(CENs). We focus on two questions: (i) whether linear explanations are always
consistent or can be misleading, and (ii) when integrated into the prediction
process, whether and how explanations affect the performance of the model. Our
analysis sheds more light on certain properties of explanations produced by
different methods and suggests that learning models that explain and predict
jointly is often advantageous.

本文研究了产生于复杂模型后期的线性解释或与上下文解释网络 (CENs) 一起产生的线性解释。研究主要聚焦于线性解释是否一直是始终如一的或容易引导，同时研究在将其整合到预测过程中时，解释是否会影响模型程序的表现。我们的分析揭示了不同方法产生的解释的某些属性，并建议共同预测和解释的学习模型经常具有优势。

模型解释的有趣特性

The Intriguing Properties of Model Explanations

Modern learning algorithms excel at producing accurate but complex models of
the data. However, deploying such models in the real-world requires extra care:
we must ensure their reliability, robustness, and absence of undesired biases.
This motivates the development of models that are equally accurate but can be
also easily inspected and assessed beyond their predictive performance. To this
end, we introduce contextual explanation networks (CEN)---a class of
architectures that learn to predict by generating and utilizing intermediate,
simplified probabilistic models. Specifically, CENs generate parameters for
intermediate graphical models which are further used for prediction and play
the role of explanations. Contrary to the existing post-hoc model-explanation
tools, CENs learn to predict and to explain simultaneously. Our approach offers
two major advantages: (i) for each prediction valid, instance-specific
explanation is generated with no computational overhead and (ii) prediction via
explanation acts as a regularizer and boosts performance in data-scarce
settings. We analyze the proposed framework theoretically and experimentally.
Our results on image and text classification and survival analysis tasks
demonstrate that CENs are not only competitive with the state-of-the-art
methods but also offer additional insights behind each prediction, that can be
valuable for decision support. We also show that while post-hoc methods may
produce misleading explanations in certain cases, CENs are consistent and allow
to detect such cases systematically.

提出使用 CEN（contextual explanation networks）架构进行预测，生成中间简化的概率模型作为解释，为每个预测生成有效的、实例特定的解释，并可用于决策支持。CEN 架构不仅和现有的最先进方法相竞争，且在决策支持方面提供了有价值的额外细节。