Abstract:The spiking neural networks (SNNs) are the third generation of neural networks and perform remarkably well in cognitive tasks such as pattern recognition. The spike emitting and information processing mechanisms found in biological cognitive systems motivate the application of the hierarchical structure and temporal encoding mechanism in spiking neural networks, which have exhibited strong computational capability. However, the hierarchical structure and temporal encoding approach require neurons to process information serially in space and time respectively, which reduce the training efficiency significantly. For training the hierarchical SNNs, most existing methods are based on the traditional back-propagation algorithm, inheriting its drawbacks of the gradient diffusion and the sensitivity on parameters. To keep the powerful computation capability of the hierarchical structure and temporal encoding mechanism, but to overcome the low efficiency of the existing algorithms, a new training algorithm, the Normalized Spiking Error Back Propagation (NSEBP) is proposed in this paper. In the feedforward calculation, the output spike times are calculated by solving the quadratic function in the spike response model instead of detecting postsynaptic voltage states at all time points in traditional algorithms. Besides, in the feedback weight modification, the computational error is propagated to previous layers by the presynaptic spike jitter instead of the gradient decent rule, which realizes the layer-wised training. Furthermore, our algorithm investigates the mathematical relation between the weight variation and voltage error change, which makes the normalization in the weight modification applicable. Adopting these strategies, our algorithm outperforms the traditional SNN multi-layer algorithms in terms of learning efficiency and parameter sensitivity, that are also demonstrated by the comprehensive experimental results in this paper.

A Supervised Learning Algorithm to Binary Classification Problem for Spiking Neural Networks

A Supervised Multi-Spike Learning Algorithm for Spiking Neural Networks

Supervised And Aggregate-Label Learning Algorithm of Spiking Neural Network

An STDP-Based Supervised Learning Algorithm for Spiking Neural Networks

Fast and Accurate Classification with a Multi-Spike Learning Algorithm for Spiking Neurons.

PC-SNN: Supervised Learning with Local Hebbian Synaptic Plasticity Based on Predictive Coding in Spiking Neural Networks

Unsupervised Spiking Neural Network with Dynamic Learning of Inhibitory Neurons

Deep Spiking Convolutional Neural Networks for Programmable Neuro-synaptic System

Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance.

Supervised Learning in Multilayer Spiking Neural Networks With Spike Temporal Error Backpropagation

First Error-Based Supervised Learning Algorithm for Spiking Neural Networks

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

A New Supervised Learning Algorithm For Spiking Neurons

Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Unsupervised Learning Based on Temporal Coding Using STDP in Spiking Neural Networks.

An Efficient Supervised Training Algorithm for Multilayer Spiking Neural Networks

Efficient Training of Supervised Spiking Neural Network Via Accurate Synaptic-Efficiency Adjustment Method

Pattern Recognition of Spiking Neural Networks Based on Visual Mechanism and Supervised Synaptic Learning

Training Spiking Neural Networks for Cognitive Tasks: A Versatile Framework Compatible with Various Temporal Codes.

Spiking Spatio-Temporal Channle