BriefGPT.xyz
Sep, 2023
基于流形的语言转换空间重新嵌入的无调参基于提示的分类
Manifold-based Verbalizer Space Re-embedding for Tuning-free Prompt-based Classification
HTML
PDF
Haochun Wang, Sendong Zhao, Chi Liu, Nuwa Xi, Muzhen Cai...
TL;DR
利用无需调参的基于流形的重新嵌入的方法(LLE-INC)改进了基于提示的分类,并且在参数更新后可进一步提高分类性能。对LLaMA-7B&13B的实验结果表明,LLE-INC是一种高效的无需调参的分类方法,适用于超大规模语言模型。
Abstract
prompt-based classification
adapts tasks to a cloze question format utilizing the [MASK] token and the filled tokens are then mapped to labels through pre-defined verbalizers. Recent studies have explored the use of
ver
→