BriefGPT.xyz
Sep, 2021
多语言模型的离散和软提示
Discrete and Soft Prompting for Multilingual Models
HTML
PDF
Mengjie Zhao, Hinrich Schütze
TL;DR
本文研究表明,在预训练语言模型中,离散和软提示表现良好,且在多语言情况下性能要优于finetuning,特别是在跨语言传递和多语言自然语言推断方面。
Abstract
It has been shown for English that discrete and
soft prompting
perform strongly in
few-shot learning
with
pretrained language models
(PLMs
→