BriefGPT.xyz
Apr, 2022
控制耐心的束搜索解码
Beam Decoding with Controlled Patience
HTML
PDF
Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Dragomir Radev, Yejin Choi...
TL;DR
在文本生成中使用 Beam Search,引入了 Patience Factor 可以提高强预训练模型在新闻文本摘要和机器翻译中的解码效果,并且只需修改一行代码即可。
Abstract
text generation
with
beam search
has proven successful in a wide range of applications. The commonly-used implementation of beam decoding follows a first come, first served heuristic: it keeps a set of already co
→