BriefGPT.xyz
Jul, 2022
基于对比视觉变换器的在线连续学习
Online Continual Learning with Contrastive Vision Transformer
HTML
PDF
Zhen Wang, Liu Liu, Yajing Kong, Jiaxian Guo, Dacheng Tao
TL;DR
本文提出了一种基于transformer架构的对比视觉转换器(CVT)框架,它设计了一种基于对比学习的强调学习策略,以实现在线学习的更好稳定性-可塑性权衡,并通过包含可学习的聚焦点来缓解遗忘。实验结果表明,CVT方法在在线持续学习基准测试中达到最先进的性能,并有效缓解了灾难性的遗忘。
Abstract
online continual learning
(online CL) studies the problem of learning sequential tasks from an online data stream without task boundaries, aiming to adapt to new data while alleviating
catastrophic forgetting
on
→