In this paper we propose a novel decomposition method based on filter group
approximation, which can significantly reduce the redundancy of deep
convolutional neural networks (CNNs) while maintaining the majority of feature
representation. Unlike other low-rank decomposition algorithms which operate on
spatial or channel dimension of filters, our proposed method mainly focuses on
exploiting the filter group structure for each layer. For several commonly used
CNN models, including VGG and ResNet, our method can reduce over 80%
floating-point operations (FLOPs) with less accuracy drop than state-of-the-art
methods on various image classification datasets. Besides, experiments
demonstrate that our method is conducive to alleviating degeneracy of the
compressed network, which hurts the convergence and performance of the network.

该论文提出了一种基于滤波器组逼近的新型分解方法，该方法可以显著减少深度卷积神经网络中的冗余，同时保持大部分特征表示，通过在每层中利用滤波器组结构，相比于其他基于低秩分解算法，我们的方法可以在多个图像分类数据集上减少 80% 以上的算术运算量（FLOPs），并减少精度损失，另外，实验证明我们的方法有助于缓解压缩网络的退化现象，从而提高网络的收敛性和性能。