Current state-of-the-art deep neural networks for image classification are
made up of 10 - 100 million learnable weights and are therefore inherently
prone to overfitting. The complexity of the weight count can be seen as a
function of the number of channels, the spatial extent of the input and the
number of layers of the network. Due to the use of convolutional layers the
scaling of weight complexity is usually linear with regards to the resolution
dimensions, but remains quadratic with respect to the number of channels.
Active research in recent years in terms of using multigrid inspired ideas in
deep neural networks have shown that on one hand a significant number of
weights can be saved by appropriate weight sharing and on the other that a
hierarchical structure in the channel dimension can improve the weight
complexity to linear. In this work, we combine these multigrid ideas to
introduce a joint framework of multigrid inspired architectures, that exploit
multigrid structures in all relevant dimensions to achieve linear weight
complexity scaling and drastically reduced weight counts. Our experiments show
that this structured reduction in weight count is able to reduce overfitting
and thus shows improved performance over state-of-the-art ResNet architectures
on typical image classification benchmarks at lower network complexity.

本论文研究了深度神经网络的过拟合问题和多重网格结构在其中的应用，提出了一种多重网格启发式体系结构框架，可以在维度间利用多重网格结构来实现线性权重复杂度缩放和大幅减少权重数量，进而在网络复杂度较低时，通过减少权重数量降低过拟合问题，相比于现有的 ResNet 架构实现更好的图像分类结果。