BriefGPT.xyz
Jul, 2023
自我监督学习中是否存在双重跌落现象？
Does Double Descent Occur in Self-Supervised Learning?
HTML
PDF
Alisia Lupidi, Yonatan Gideoni, Dulhan Jayalath
TL;DR
在自监督模型中，双下降现象可能不存在，两种未被研究的设置（标准自编码器和线性自编码器）的测试损失曲线分别为经典的U形或单调递减形，这一结果帮助我们更好地认识此现象的理论基础。
Abstract
Most investigations into
double descent
have focused on supervised models while the few works studying self-supervised settings find a surprising lack of the phenomenon. These results imply that
double descent
ma
→