BriefGPT.xyz
Jun, 2023
使用语言模型的学习界限
Limits for Learning with Language Models
HTML
PDF
Nicholas Asher, Swarnadeep Bhar, Akshay Chaturvedi, Julie Hunter, Soumya Paul
TL;DR
本文研究大语言模型在自然语言处理中的局限性，特别是无法学习一些基本语义属性，如语义蕴涵和一致性，以及不能学习超越Borel层次结构的概念，这对语言模型的语言理解能力产生了严重限制。
Abstract
With the advent of
large language models
(LLMs), the trend in
nlp
has been to train LLMs on vast amounts of data to solve diverse language understanding and generation tasks. The list of LLM successes is long and
→