BriefGPT.xyz
Oct, 2022
句子生成任务中的记忆提取技术
Finding Memo: Extractive Memorization in Constrained Sequence Generation Tasks
HTML
PDF
Vikas Raunak, Arul Menezes
TL;DR
本研究研究了自然语言生成任务中的提取性记忆及其对神经机器翻译的影响,并提出了一种新的算法来生成确切的训练数据以减轻模型中的记忆问题,并通过微调来解决这个问题。
Abstract
Memorization presents a challenge for several constrained
natural language generation
(NLG) tasks such as
neural machine translation
(NMT), wherein the proclivity of neural models to memorize noisy and atypical s
→