Nov, 2023
探索上下文学习与指导调整之间的关系
Exploring the Relationship between In-Context Learning and Instruction
Tuning
TL;DRIn this work, the relationship between In-Context Learning (ICL) and Instruction Tuning (IT) is explored by examining how the hidden states of Large Language Models (LLMs) change in these two paradigms, finding that ICL is implicit IT and the convergence is contingent upon factors related to the provided demonstrations.