BriefGPT.xyz
Jan, 2022
像编程执行器一样推理
Reasoning Like Program Executors
HTML
PDF
Xinyu Pi, Qian Liu, Bei Chen, Morteza Ziyadi, Zeqi Lin...
TL;DR
本文提出了POET,一种新颖的推理预训练范式,使用程序及其执行结果对语言模型进行预训练,可以显著提高自然语言推理的模型性能,包括数字推理、逻辑推理和多跳推理。
Abstract
reasoning
over natural language is a long-standing goal for the research community. However, studies have shown that existing language models are inadequate in
reasoning
. To address the issue, we present
→