By stacking layers of convolution and nonlinearity, convolutional networks
(ConvNets) effectively learn from low-level to high-level features and
discriminative representations. Since the end goal of large-scale recognition
is to delineate complex boundaries of thousands of classes, adequate
exploration of feature distributions is important for realizing full potentials
of ConvNets. However, state-of-the-art works concentrate only on deeper or
wider architecture design, while rarely exploring feature statistics higher
than first-order. We take a step towards addressing this problem. Our method
consists in covariance pooling, instead of the most commonly used first-order
pooling, of high-level convolutional features. The main challenges involved are
robust covariance estimation given a small sample of large-dimensional features
and usage of the manifold structure of covariance matrices. To address these
challenges, we present a Matrix Power Normalized Covariance (MPN-COV) method.
We develop forward and backward propagation formulas regarding the nonlinear
matrix functions such that MPN-COV can be trained end-to-end. In addition, we
analyze both qualitatively and quantitatively its advantage over the well-known
Log-Euclidean metric. On the ImageNet 2012 validation set, by combining MPN-COV
we achieve over 4%, 3% and 2.5% gains for AlexNet, VGG-M and VGG-16,
respectively; integration of MPN-COV into 50-layer ResNet outperforms
ResNet-101 and is comparable to ResNet-152. The source code will be available
on the project page: this http URL

该论文提出了一种基于高级特征的协方差汇集方法，即 Matrix Power Normalized Covariance (MPN-COV)，并在 ImageNet 上的测试中表现出了显著的成果，特别是在 AlexNet，VGG-M 和 VGG-16 的情况下，MPN-COV 方法可以使性能提高超过 3％，并且与 ResNet-152 相媲美。