We develop a system for the FEVER fact extraction and verification challenge
that uses a high precision entailment classifier based on transformer networks
pretrained with language modeling, to classify a broad set of potential
evidence. The precision of the entailment classifier allows us to enhance
recall by considering every statement from several articles to decide upon each
claim. We include not only the articles best matching the claim text by TFIDF
score, but read additional articles whose titles match named entities and
capitalized expressions occurring in the claim text. The entailment module
evaluates potential evidence one statement at a time, together with the title
of the page the evidence came from (providing a hint about possible pronoun
antecedents). In preliminary evaluation, the system achieves .5736 FEVER score,
.6108 label accuracy, and .6485 evidence F1 on the FEVER shared task test set.

本研究开发了一种基于 transformer 网络预训练的高精度蕴含分类器，用于对 FEVER 事实提取和验证挑战中的广泛潜在证据进行分类，从而提高了召回率；在初步评估中，该系统在 FEVER 公共数据集上取得了.5736 的 FEVER 得分、.6108 的标签准确性和.6485 的证据 F1 值。