This paper presents an automatic network adaptation method that finds a
ConvNet structure well-suited to a given target task, e.g., image
classification, for efficiency as well as accuracy in transfer learning. We
call the concept target-aware transfer learning. Given only small-scale labeled
data, and starting from an ImageNet pre-trained network, we exploit a scheme of
removing its potential redundancy for the target task through iterative
operations of filter-wise pruning and network optimization. The basic
motivation is that compact networks are on one hand more efficient and should
also be more tolerant, being less complex, against the risk of overfitting
which would hinder the generalization of learned representations in the context
of transfer learning. Further, unlike existing methods involving network
simplification, we also let the scheme identify redundant portions across the
entire network, which automatically results in a network structure adapted to
the task at hand. We achieve this with a few novel ideas: (i) cumulative sum of
activation statistics for each layer, and (ii) a priority evaluation of pruning
across multiple layers. Experimental results by the method on five datasets
(Flower102, CUB200-2011, Dog120, MIT67, and Stanford40) show favorable
accuracies over the related state-of-the-art techniques while enhancing the
computational and storage efficiency of the transferred model.

本论文提出了一种自动网络适应方法，该方法通过迭代的滤波剪枝和网络优化，从 ImageNet 预训练的网络中去除目标任务的潜在冗余，实现紧凑、高效、适应目标任务的网络结构，并在五个实验数据集上表现出了优异的精度和计算效率。