BriefGPT.xyz
May, 2019
通过对抗信念匹配实现零样本知识迁移
Zero-shot Knowledge Transfer via Adversarial Belief Matching
HTML
PDF
Paul Micaelli, Amos Storkey
TL;DR
通过使用对抗生成器训练学生模型,从而在没有任何数据或元数据的情况下,将来自大型教师网络的知识迁移到小型学生网络中,实现了零数据的跨数据集知识迁移,并在少样本下获得了比实际数据集的更好效果。
Abstract
Performing
knowledge transfer
from a large teacher network to a smaller student is a popular task in modern
deep learning
applications. However, due to growing dataset sizes and stricter
→