BriefGPT.xyz
Jan, 2019
DELTA: 使用带特征映射注意力机制的深度学习迁移卷积网络
DELTA: DEep Learning Transfer using Feature Map with Attention for Convolutional Networks
HTML
PDF
Xingjian Li, Haoyi Xiong, Hanchao Wang, Yuxuan Rao, Liping Liu...
TL;DR
本研究提出了一种新的正则化转移学习框架DELTA,与现有基线算法相比,DELTA通过特征映射对齐来保持目标网络的外层输出,使用注意力有效选择相关特征,实现了更高的准确性。
Abstract
transfer learning
through fine-tuning a
pre-trained neural network
with an extremely large dataset, such as ImageNet, can significantly accelerate training while the accuracy is frequently bottlenecked by the lim
→