BriefGPT.xyz
Jun, 2024
连续学习中的遗忘顺序:先学的例子最后遗忘
Forgetting Order of Continual Learning: Examples That are Learned First are Forgotten Last
HTML
PDF
Guy Hacohen, Tinne Tuytelaars
TL;DR
通过分析发现,catastrophic forgetting与学习速度存在强烈相关性,我们提出了一种名为Goldilocks的回放缓冲采样方法,该方法通过筛选中间速度学习的示例来改进现有的持续学习算法,从而在几个图像分类任务中实现了最先进的性能。
Abstract
catastrophic forgetting
poses a significant challenge in
continual learning
, where models often forget previous tasks when trained on new data. Our empirical analysis reveals a strong correlation between
→