BriefGPT.xyz
Mar, 2023
软赢子网络实现无遗忘连续学习
Forget-free Continual Learning with Soft-Winning SubNetworks
HTML
PDF
Haeyong Kang, Jaehong Yoon, Sultan Rizky Madjid, Sung Ju Hwang, Chang D. Yoo
TL;DR
提出的WNS和SoftNet方法使神经网络可以连续学习并选择从执行任务中产生的自适应二进制和非二进制子网络,该方法在任务递增学习中不会产生灾难性遗忘,并表现出比WSN更高的性能。
Abstract
Inspired by
regularized lottery ticket hypothesis
(RLTH), which states that competitive smooth (non-binary) subnetworks exist within a dense network in
continual learning
tasks, we investigate two proposed archit
→