Local Hebbian learning is believed to be inferior in performance to
end-to-end training using a backpropagation algorithm. We question this popular
belief by designing a local algorithm that can learn convolutional filters at
scale on large image datasets. These filters combined with patch normalization
and very steep non-linearities result in a good classification accuracy for
shallow networks trained locally, as opposed to end-to-end. The filters learned
by our algorithm contain both orientation selective units and unoriented color
units, resembling the responses of pyramidal neurons located in the cytochrome
oxidase 'interblob' and 'blob' regions in the primary visual cortex of
primates. It is shown that convolutional networks with patch normalization
significantly outperform standard convolutional networks on the task of
recovering the original classes when shadows are superimposed on top of
standard CIFAR-10 images. Patch normalization approximates the retinal
adaptation to the mean light intensity, important for human vision. We also
demonstrate a successful transfer of learned representations between CIFAR-10
and ImageNet 32x32 datasets. All these results taken together hint at the
possibility that local unsupervised training might be a powerful tool for
learning general representations (without specifying the task) directly from
unlabeled data.

本文提出了一种局部学习算法，结合图像数据和卷积滤波器、块归一化和非线性方法，可以成功地对 CIFAR-10 和 ImageNet 32x32 数据集进行分类，并展示了有关如何使用无标签数据从中学习通用表示的成功转移学习案例。