The advent of large pre-trained language models has made it possible to make high-quality predictions on how to add or change a sentence in a document. However, the high branching factor inherent to text generation impedes the ability of even the strongest language models to offer useful editing suggestions at a more global or document level. We introduce a new task, document sketching, which involves generating entire draft documents for the writer to review and revise. These drafts are built from sets of documents that overlap in form - sharing large segments of potentially reusable text - while diverging in content. To support this task, we introduce a Wikipedia-based dataset of analogous documents and investigate the application of weakly supervised methods, including use of a transformer-based mixture of experts, together with reinforcement learning. We report experiments using automated and human evaluation methods and discuss relative merits of these models.

本文介绍了一种新的任务：文档素描，该任务涉及为作者生成完整的草稿文件以供查看和修订，并介绍了基于维基百科的类似文件的数据集，以及弱监督方法（包括基于变压器的专家混合体和强化学习）的应用。通过自动化和人工评估方法对实验进行了报告，并讨论了这些模型的相对优点。

自动文档草图：从类似文本生成草稿