Although widely adopted, existing approaches for fine-tuning pre-trained
language models have been shown to be unstable across hyper-parameter settings,
motivating recent work on trust region methods. In this paper, we present a
simplified and efficient method rooted in trust region theory that replaces
previously used adversarial objectives with parametric noise (sampling from
either a normal or uniform distribution), thereby discouraging representation
change during fine-tuning when possible without hurting performance. We also
introduce a new analysis to motivate the use of trust region methods more
generally, by studying representational collapse; the degradation of
generalizable representations from pre-trained models as they are fine-tuned
for a specific end task. Extensive experiments show that our fine-tuning method
matches or exceeds the performance of previous trust region methods on a range
of understanding and generation tasks (including DailyMail/CNN, Gigaword,
Reddit TIFU, and the GLUE benchmark), while also being much faster. We also
show that it is less prone to representation collapse; the pre-trained models
maintain more generalizable representations every time they are fine-tuned.

本论文提出了基于信任区域理论的简化和高效的 fine-tuning 方法，用参数化噪音代替了以前使用的对抗目标，从而在不损害性能的情况下尽可能地减少表示更改。针对 fine-tuning 时的表示崩溃问题，我们还引入了一种新的分析方法。实验证明，我们的 fine-tuning 方法在多种任务上效果优秀且速度更快，在表示的泛化性方面也更稳定。