BriefGPT.xyz
Mar, 2023
架构、数据集和模型规模无关的无数据元学习
Architecture, Dataset and Model-Scale Agnostic Data-free Meta-Learning
HTML
PDF
Zixuan Hu, Li Shen, Zhenyi Wang, Tongliang Liu, Chun Yuan...
TL;DR
通过“purER”框架,我们可以进行数据免费元学习,利用已有的预训练模型进行元学习,并使用伪学习集训练新的元模型以适应新的任务分布。
Abstract
The goal of
data-free meta-learning
is to learn useful prior knowledge from a collection of
pre-trained models
without accessing their training data. However, existing works only solve the problem in parameter sp
→