The recent development of data-driven AI promises to automate medical
diagnosis; however, most AI functions as 'black boxes' to physicians with
limited computational knowledge. Using medical imaging as a point of departure,
we conducted three iterations of design activities to formulate CheXplain---a
system that enables physicians to explore and understand AI-enabled chest X-ray
analysis: (1) a paired survey between referring physicians and radiologists
reveals whether, when, and what kinds of explanations are needed; (2) a
low-fidelity prototype co-designed with three physicians formulates eight key
features; and (3) a high-fidelity prototype evaluated by another six physicians
provides detailed summative insights on how each feature enables the
exploration and understanding of AI. We summarize by discussing recommendations
for future work to design and implement explainable medical AI systems that
encompass four recurring themes: motivation, constraint, explanation, and
justification.

该研究拟定了 CheXplain 系统，以帮助医生了解和探索基于人工智能的胸透分析，并提出了设计可解释的医学人工智能系统的建议。