The backpropagation of error algorithm (BP) is impossible to implement in a
real brain. The recent success of deep networks in machine learning and AI,
however, has inspired proposals for understanding how the brain might learn
across multiple layers, and hence how it might approximate BP. As of yet, none
of these proposals have been rigorously evaluated on tasks where BP-guided deep
learning has proved critical, or in architectures more structured than simple
fully-connected networks. Here we present results on scaling up biologically
motivated models of deep learning on datasets which need deep networks with
appropriate architectures to achieve good performance. We present results on
the MNIST, CIFAR-10, and ImageNet datasets and explore variants of
target-propagation (TP) and feedback alignment (FA) algorithms, and explore
performance in both fully- and locally-connected architectures. We also
introduce weight-transport-free variants of difference target propagation (DTP)
modified to remove backpropagation from the penultimate layer. Many of these
algorithms perform well for MNIST, but for CIFAR and ImageNet we find that TP
and FA variants perform significantly worse than BP, especially for networks
composed of locally connected units, opening questions about whether new
architectures and algorithms are required to scale these approaches. Our
results and implementation details help establish baselines for biologically
motivated deep learning schemes going forward.

通过对 MNIST、CIFAR-10 和 ImageNet 数据集中的机器学习任务进行实验，我们提出和探究了目标传播和反馈对齐算法的变体，在全连接和局部连接的体系结构下，大部分算法都可以很好的完成 MNIST 数据集的任务。然而，我们发现在面对 CIFAR 和 ImageNet 数据集时，这些算法在局部连接的体系结构下表现不如反向传播算法，因此我们需要新的架构和算法来扩展这些方法。