This paper introduces Summary Explorer, a new tool to support the manual
inspection of text summarization systems by compiling the outputs of
55~state-of-the-art single document summarization approaches on three benchmark
datasets, and visually exploring them during a qualitative assessment. The
underlying design of the tool considers three well-known summary quality
criteria (coverage, faithfulness, and position bias), encapsulated in a guided
assessment based on tailored visualizations. The tool complements existing
approaches for locally debugging summarization models and improves upon them.
The tool is available at this https URL

介绍了 Summary Explorer 工具，它通过在三个基准数据集上编译 55 种最先进的单文档摘要方法的输出，并在定性评估过程中进行视觉探索以支持文本摘要系统的手动检查。该工具考虑了三个著名的摘要质量标准（覆盖率、真实性和位置偏差），并通过定制的可视化引导评估进行了封装。该工具补充了现有的本地调试摘要模型方法，并对其进行了改进。工具可在 https URL 上获得。