BriefGPT.xyz
Sep, 2021
RoR:长文档机器阅读理解中的逐字阅读
RoR: Read-over-Read for Long Document Machine Reading Comprehension
HTML
PDF
Jing Zhao, Junwei Bao, Yifan Wang, Yongwei Zhou, Youzheng Wu...
TL;DR
提出RoR方法,从块到文档扩展阅读范围,它包括块阅读器和文档阅读器,并且在两个基准测试QuAC和TriviaQA上进行的大量实验表明了RoR对于长文档阅读的有效性。
Abstract
transformer-based pre-trained models
, such as BERT, have achieved remarkable results on
machine reading comprehension
. However, due to the constraint of encoding length (e.g., 512 WordPiece tokens), a
→