Recently, Multilayer Perceptron (MLP) becomes the hotspot in the field of
computer vision tasks. Without inductive bias, MLPs perform well on feature
extraction and achieve amazing results. However, due to the simplicity of their
structures, the performance highly depends on the local features communication
machenism. To further improve the performance of MLP, we introduce information
communication mechanisms from brain-inspired neural networks. Spiking Neural
Network (SNN) is the most famous brain-inspired neural network, and achieve
great success on dealing with sparse data. Leaky Integrate and Fire (LIF)
neurons in SNNs are used to communicate between different time steps. In this
paper, we incorporate the machanism of LIF neurons into the MLP models, to
achieve better accuracy without extra FLOPs. We propose a full-precision LIF
operation to communicate between patches, including horizontal LIF and vertical
LIF in different directions. We also propose to use group LIF to extract better
local features. With LIF modules, our SNN-MLP model achieves 81.9%, 83.3% and
83.5% top-1 accuracy on ImageNet dataset with only 4.4G, 8.5G and 15.2G FLOPs,
respectively, which are state-of-the-art results as far as we know.

本文介绍了如何在多层感知器（MLP）中使用漏泄整合和火（LIF）神经元来构建以 SNN 为灵感的神经网络机制，通过改进局部特征沟通机制来提高精度，最终在 ImageNet 数据集上取得 81.9％至 83.5％的 top-1 准确度的最新成果。

基于脉冲神经元的脑启发式多层感知器

Brain-inspired Multilayer Perceptron with Spiking Neurons

We describe a method to train spiking deep networks that can be run using
leaky integrate-and-fire (LIF) neurons, achieving state-of-the-art results for
spiking LIF networks on five datasets, including the large ImageNet ILSVRC-2012
benchmark. Our method for transforming deep artificial neural networks into
spiking networks is scalable and works with a wide range of neural
nonlinearities. We achieve these results by softening the neural response
function, such that its derivative remains bounded, and by training the network
with noise to provide robustness against the variability introduced by spikes.
Our analysis shows that implementations of these networks on neuromorphic
hardware will be many times more power-efficient than the equivalent
non-spiking networks on traditional hardware.

本文介绍了一种方法，该方法可以训练使用 Leaky Integrate-and-Fire（LIF）神经元的脉冲深度网络，并在包括大型 ImageNet ILSVRC-2012 基准测试在内的五个数据集上取得了最先进的结果。该方法可扩展，并适用于各种神经非线性。通过软化神经响应函数以使其导数保持有界，并通过噪声训练网络，我们实现了这些结果，以提高其承受由脉冲引入的变异性的鲁棒性。我们的分析表明，在神经形态硬件上实现这些网络将比传统硬件上等效的非脉冲网络更加节能。