BriefGPT.xyz
May, 2023
随机桥作为参数有效调整的有效正则化方法
Stochastic Bridges as Effective Regularizers for Parameter-Efficient Tuning
HTML
PDF
Weize Chen, Xu Han, Yankai Lin, Zhiyuan Liu, Maosong Sun...
TL;DR
本研究提出使用隐性随机桥作为正则化方法来优化参数效率调节方法(PETs)中的中间状态,并表明这种正则化方法可以适用于不同领域和任务的PLM。
Abstract
parameter-efficient tuning methods
(PETs) have achieved promising results in tuning large
pre-trained language models
(PLMs). By formalizing frozen PLMs and additional tunable parameters as systems and controls r
→