We present an overview of the SciVer shared task, presented at the 2nd
Scholarly Document Processing (SDP) workshop at NAACL 2021. In this shared
task, systems were provided a scientific claim and a corpus of research
abstracts, and asked to identify which articles SUPPORT or REFUTE the claim as
well as provide evidentiary sentences justifying those labels. 11 teams made a
total of 14 submissions to the shared task leaderboard, leading to an
improvement of more than +23 F1 on the primary task evaluation metric. In
addition to surveying the participating systems, we provide several insights
into modeling approaches to support continued progress and future research on
the important and challenging task of scientific claim verification.

本文概述了在第二届 NAACL 2021 学术文档处理（SDP）研讨会上介绍的 SciVer 共享任务，在该任务中，系统需要识别支持或反驳科学论断的文章以及提供证明标签的证据句子。11 个团队共提交了 14 份成果，主要任务评估指标上的 F1 分数有了超过 23 的提升。除了调查参与系统外，我们还提供了一些模型方法的见解，以支持科学主张验证这一重要而具有挑战性的任务的持续进展和未来研究。