BriefGPT.xyz
Sep, 2023
多标签文本分类的上下文学习
In-Context Learning for Text Classification with Many Labels
HTML
PDF
Aristides Milios, Siva Reddy, Dzmitry Bahdanau
TL;DR
利用预训练的密集检索模型,我们在有限样本设置中的常见意图分类数据集上,以及特定情况下的细粒度情感分类中,优于微调性能。通过多个实验,我们分析了模型对于上下文示例和不同模型规模的利用情况,并展示了在不同领域中需要不同程度上下文示例的相似性、类名的语义内容和示例与标签之间的正确对应。
Abstract
in-context learning
(ICL) using
large language models
for tasks with many labels is challenging due to the limited context window, which makes it difficult to fit a sufficient number of examples in the prompt. In
→