Backpropagation (BP), a foundational algorithm for training artificial neural
networks, predominates in contemporary deep learning. Although highly
successful, it is often considered biologically implausible. A significant
limitation arises from the need for precise symmetry between connections in the
backward and forward pathways to backpropagate gradient signals accurately,
which is not observed in biological brains. Researchers have proposed several
algorithms to alleviate this symmetry constraint, such as feedback alignment
and direct feedback alignment. However, their divergence from backpropagation
dynamics presents challenges, particularly in deeper networks and convolutional
layers. Here we introduce the Product Feedback Alignment (PFA) algorithm. Our
findings demonstrate that PFA closely approximates BP and achieves comparable
performance in deep convolutional networks while avoiding explicit weight
symmetry. Our results offer a novel solution to the longstanding weight
symmetry problem, leading to more biologically plausible learning in deep
convolutional networks compared to earlier methods.

提出了 Product Feedback Alignment（PFA）算法，它在避免显式的权重对称的同时，几乎与反向传播（BP）算法相同，能够在深度卷积网络中实现可比较的性能，从而提供了对长期存在的权重对称问题的新解决方案，实现了更加符合生物合理性的深度卷积网络学习。