BriefGPT.xyz
Mar, 2024
学习带有噪音基础模型
Learning with Noisy Foundation Models
HTML
PDF
Hao Chen, Jindong Wang, Zihan Wang, Ran Tao, Hongxin Wei...
TL;DR
该论文通过广泛的实验证明,虽然在预训练中存在一定的噪声可以提高域内性能,但它总是破坏域外性能,然后提出了一种调整方法来减轻噪声的不良影响并提高泛化能力。
Abstract
foundation models
are usually pre-trained on large-scale datasets and then adapted to
downstream tasks
through tuning. However, the large-scale
p
→