Abstract:Abstract Our real-time actions in everyday life reflect a range of spatiotemporal dynamic brain activity patterns, the consequence of neuronal computation with spikes in the brain. Most existing models with spiking neurons aim at solving static pattern recognition tasks such as image classification. Compared with static features, spatiotemporal patterns are more complex due to their dynamics in both space and time domains. Spatiotemporal pattern recognition based on learning algorithms with spiking neurons therefore remains challenging. We propose an end-to-end recurrent spiking neural network model trained with an algorithm based on spike latency and temporal difference backpropagation. Our model is a cascaded network with three layers of spiking neurons where the input and output layers are the encoder and decoder, respectively. In the hidden layer, the recurrently connected neurons with transmission delays carry out high-dimensional computation to incorporate the spatiotemporal dynamics of the inputs. The test results based on the data sets of spiking activities of the retinal neurons show that the proposed framework can recognize dynamic spatiotemporal patterns much better than using spike counts. Moreover, for 3D trajectories of a human action data set, the proposed framework achieves a test accuracy of 83.6% on average. Rapid recognition is achieved through the learning methodology–based on spike latency and the decoding process using the first spike of the output neurons. Taken together, these results highlight a new model to extract information from activity patterns of neural computation in the brain and provide a novel approach for spike-based neuromorphic computing.

Character Recognition from Trajectory by Recurrent Spiking Neural Networks

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Dynamic Spatiotemporal Pattern Recognition with Recurrent Spiking Neural Network

A Spiking Neural Network System for Robust Sequence Recognition

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

A Spike-Timing Based Integrated Model for Pattern Recognition

Spiking Neural Network Recognition Method Based on Dynamic Visual Motion Features

An Event-Driven Computational System With Spiking Neurons For Object Recognition

Spiking Neural Networks for event-based action recognition: A new task to understand their advantage

Event-based Action Recognition Using Motion Information and Spiking Neural Networks

Application Of Precise-Spike-Driven Rule In Spiking Neural Networks For Optical Character Recognition

An Image Recognizing Method Based on Precise Moment of Spikes

A Neurally Inspired Pattern Recognition Approach with Latency-Phase Encoding and Precise-Spike-driven Rule in Spiking Neural Network.

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Motorsrnn: A Spiking Recurrent Neural Network Inspired by Brain Topology for the Effective and Efficient Decoding of Cortical Spike Trains

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Pattern Recognition of a Spiking Neural Network Based on Visual Motion Model

Encoding Sensory and Motor Patterns as Time-Invariant Trajectories in Recurrent Neural Networks

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning