The combination of spiking neural networks and event-based vision sensors
holds the potential of highly efficient and high-bandwidth optical flow
estimation. This paper presents the first hierarchical spiking architecture in
which motion (direction and speed) selectivity emerges in an unsupervised
fashion from the raw stimuli generated with an event-based camera. A novel
adaptive neuron model and stable spike-timing-dependent plasticity formulation
are at the core of this neural network governing its spike-based processing and
learning, respectively. After convergence, the neural architecture exhibits the
main properties of biological visual motion systems, namely feature extraction
and local and global motion perception. Convolutional layers with input
synapses characterized by single and multiple transmission delays are employed
for feature and local motion perception, respectively; while global motion
selectivity emerges in a final fully-connected layer. The proposed solution is
validated using synthetic and real event sequences. Along with this paper, we
provide the cuSNN library, a framework that enables GPU-accelerated simulations
of large-scale spiking neural networks. Source code and samples are available
at this https URL

本文提出了一种基于事件相机的分层尖峰神经网络结构，利用自适应神经元模型和稳定的 STDP 公式，实现了运动（方向和速度）选择的无监督特征提取和局部全局运动感知，验证了在合成和实际事件序列中具有生物视觉运动系统的主要属性，提供了一种能够加速大规模尖峰神经网络模拟的 cuSNN 库。