Interest in biologically inspired alternatives to backpropagation is driven
by the desire to both advance connections between deep learning and
neuroscience and address backpropagation's shortcomings on tasks such as
online, continual learning. However, local synaptic learning rules like those
employed by the brain have so far failed to match the performance of
backpropagation in deep networks. In this study, we employ meta-learning to
discover networks that learn using feedback connections and local, biologically
inspired learning rules. Importantly, the feedback connections are not tied to
the feedforward weights, avoiding biologically implausible weight transport.
Our experiments show that meta-trained networks effectively use feedback
connections to perform online credit assignment in multi-layer architectures.
Surprisingly, this approach matches or exceeds a state-of-the-art
gradient-based online meta-learning algorithm on regression and classification
tasks, excelling in particular at continual learning. Analysis of the weight
updates employed by these models reveals that they differ qualitatively from
gradient descent in a way that reduces interference between updates. Our
results suggest the existence of a class of biologically plausible learning
mechanisms that not only match gradient descent-based learning, but also
overcome its limitations.

本研究使用元学习发现网络如何利用反馈机制和本地、仿生学习规则，以进行在线信用分配，并超越了现有的基于梯度的算法在回归和分类任务方面的性能，特别是在持续学习方面表现优异，结果表明存在一类生物可行的学习机制，不仅匹配梯度下降，而且还克服了其局限性。