BriefGPT.xyz
Dec, 2020
多域多任务重复训练的终身学习
Multi-Domain Multi-Task Rehearsal for Lifelong Learning
HTML
PDF
Fan Lyu, Shuai Wang, Wei Feng, Zihan Ye, Fuyuan Hu...
TL;DR
本文提出了MDMT方法,采用两级角分界损失以及记忆的情节蒸馏损失来对抗意外的领域漂移,平等地训练新旧任务,从而打破任务间的隔离,并通过对基准数据集的实验验证其能有效地缓解这种不可预测的领域漂移。
Abstract
rehearsal
, seeking to remind the model by storing old knowledge in lifelong learning, is one of the most effective ways to mitigate
catastrophic forgetting
, i.e., biased forgetting of previous knowledge when movi
→