BriefGPT.xyz
May, 2021
DExperts: 控制生成时间的文本生成模型，结合专家和反向专家
On-the-Fly Controlled Text Generation with Experts and Anti-Experts
HTML
PDF
Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula...
TL;DR
我们提出Decoding-time Experts方法，结合预训练语言模型和“专家”LM和/或“反专家”LM的专家集，实现了受控文本生成，适用于情感控制语言（如语言净化），且优于现有技术。
Abstract
Despite recent advances in natural language generation, it remains challenging to control attributes of generated text. We propose DExperts:
decoding-time experts
, a decoding-time method for
controlled text generation
→