Abstract:Abstract Our real-time actions in everyday life reflect a range of spatiotemporal dynamic brain activity patterns, the consequence of neuronal computation with spikes in the brain. Most existing models with spiking neurons aim at solving static pattern recognition tasks such as image classification. Compared with static features, spatiotemporal patterns are more complex due to their dynamics in both space and time domains. Spatiotemporal pattern recognition based on learning algorithms with spiking neurons therefore remains challenging. We propose an end-to-end recurrent spiking neural network model trained with an algorithm based on spike latency and temporal difference backpropagation. Our model is a cascaded network with three layers of spiking neurons where the input and output layers are the encoder and decoder, respectively. In the hidden layer, the recurrently connected neurons with transmission delays carry out high-dimensional computation to incorporate the spatiotemporal dynamics of the inputs. The test results based on the data sets of spiking activities of the retinal neurons show that the proposed framework can recognize dynamic spatiotemporal patterns much better than using spike counts. Moreover, for 3D trajectories of a human action data set, the proposed framework achieves a test accuracy of 83.6% on average. Rapid recognition is achieved through the learning methodology–based on spike latency and the decoding process using the first spike of the output neurons. Taken together, these results highlight a new model to extract information from activity patterns of neural computation in the brain and provide a novel approach for spike-based neuromorphic computing.

Spiking neural network for visual pattern recognition

Spiking Neural Network Recognition Method Based on Dynamic Visual Motion Features

A Neurally Inspired Pattern Recognition Approach with Latency-Phase Encoding and Precise-Spike-driven Rule in Spiking Neural Network.

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Fast Unsupervised Learning for Visual Pattern Recognition Using Spike Timing Dependent Plasticity.

A Spike-Timing Based Integrated Model for Pattern Recognition

Spiking-timing based pattern recognition with real-world visual stimuli

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Event-based Action Recognition Using Motion Information and Spiking Neural Networks

Application Of Precise-Spike-Driven Rule In Spiking Neural Networks For Optical Character Recognition

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Relative ordering learning in spiking neural network for pattern recognition

Spike-Visnet: A Novel Framework for Visual Recognition with Focuslayer-Stdp Learning

A Parallel Spiking Neural Network Based on Adaptive Lateral Inhibition Mechanism for Objective Recognition

Bio-Inspired Spiking Neural Networks for Facial Expression Recognition - Generalisation Investigation.

A Supervised Multi-Spike Learning Algorithm for Spiking Neural Networks

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

Temporal Pattern Recognition Using Spiking Neural Networks for Cortical Neuronal Spike Train Decodin

Dynamic Spatiotemporal Pattern Recognition with Recurrent Spiking Neural Network

A Spiking Neural Network System for Robust Sequence Recognition

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception