BriefGPT.xyz
Apr, 2023
从零到英雄:探究符号任务在指导调整中的作用
From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning
HTML
PDF
Qian Liu, Fan Zhou, Zhengbao Jiang, Longxu Dou, Min Lin
TL;DR
本研究提出一种采用符号任务来增强指令调整的简单而有效方法,在多个基准测试中验证该方法可以提高语言模型的零-shot表推理能力,并证明符号任务不会影响语言模型的普适性。
Abstract
Fine-tuning
language models
on tasks with instructions has demonstrated potential in facilitating
zero-shot generalization
to unseen tasks. In this paper, we introduce a straightforward yet effective method for e
→