BriefGPT.xyz
Mar, 2022
混沌即阶梯:通过增强重叠来理解对比学习的新理论
Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap
HTML
PDF
Yifei Wang, Qi Zhang, Yisen Wang, Jiansheng Yang, Zhouchen Lin
TL;DR
该论文提出了一种新的自监督学习模型,采用数据增强的方法对正样本进行对齐,从而提高下游性能,并通过ARC无监督模型选择度量与下游精度相对应。
Abstract
Recently,
contrastive learning
has risen to be a promising approach for large-scale
self-supervised learning
. However, theoretical understanding of how it works is still unclear. In this paper, we propose a new g
→