BriefGPT.xyz
Nov, 2021
大型预训练语言模型在自然语言处理中的最新研究进展：综述
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey
HTML
PDF
Bonan Min, Hayley Ross, Elior Sulem, Amir Pouran Ben Veyseh, Thien Huu Nguyen...
TL;DR
本文介绍了使用预训练和微调、提示或文本生成方法解决NLP任务的大型预训练基于transformer的语言模型，以及使用预训练语言模型生成数据进行训练或其他目的的方法，并讨论未来研究的限制和建议方向。
Abstract
Large, pre-trained
transformer-based language models
such as
bert
have drastically changed the Natural Language Processing (NLP) field. We present a survey of recent work that uses these large language models to
→