BriefGPT.xyz
May, 2021
任务无关连续学习的编码器和集成方法
Encoders and Ensembles for Task-Free Continual Learning
HTML
PDF
Murray Shanahan, Christos Kaplanis, Jovana Mitrović
TL;DR
使用对比自监督学习和集成模型的方法,构建一个架构,以有效地进行连续学习,同时避免灾难性遗忘,对多个基准测试问题进行评估并取得了优异的表现。
Abstract
We present an architecture that is effective for
continual learning
in an especially demanding setting, where task boundaries do not exist or are unknown. Our architecture comprises an encoder, pre-trained on a separate dataset, and an
→