Abstract:This paper develops a new approach to estimate predicted class probabilities in deep Spiking Neural Networks (SNN) that encourages faster classification. The proposed approach utilizes the temporal separation between the first spikes generated by the output neurons to estimate the predicted class probabilities which are then used with cross entropy loss for training the network. This maximizes the separation between the first spikes generated by the neuron associated with the correct class and neurons associated with other classes. Higher classification performance is obtained by maximising the temporal separation, which also drives the correct class neuron to spike earlier in the simulation. As a consequence, the predicted class may be determined from the first spike in the output layer, leading to quicker classification. The sensitivity factor for each neuron in the network is estimated via error-backpropagation during training. Using Spike Timing Dependent Plasticity (STDP) regulated by the estimated sensitivity factors, the network weights are updated. It results that the learning method is termed as Temporal Separation Modulated Spike Timing Dependent Plasticity (TSM-STDP). On the benchmark MNIST dataset, the performance of TSM-STDP has been assessed, and the evaluation results are compared with those of other learning methods for SNNs. Additionally, a histogram of the output layer's first spikes demonstrated that the right class neurons spiked earlier in the simulation than other class neurons, enabling faster classification. On real-world Attention Deficit Hyperactivity Disorder (ADHD) detection dataset, the effectiveness of TSM-STDP has also been assessed and compared with other available approaches. The performance comparison results clearly show that TSM-STDP can achieve classification performance comparable to other existing learning algorithms on benchmark and real-world datasets while requiring less time for classification.

Supervised Learning in Temporally-Coded Spiking Neural Networks with Approximate Backpropagation

Supervised Learning Based on Temporal Coding in Spiking Neural Networks

Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function: Learning with Backpropagation

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Unsupervised Learning Based on Temporal Coding Using STDP in Spiking Neural Networks.

Efficient Spiking Neural Networks with Logarithmic Temporal Coding.

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Temporal Learning In Multilayer Spiking Neural Networks Through Construction Of Causal Connections

A Supervised Multi-Spike Learning Algorithm for Spiking Neural Networks

Supervised Learning with First-to-Spike Decoding in Multilayer Spiking Neural Networks

An STDP-Based Supervised Learning Algorithm for Spiking Neural Networks

Supervised Learning in Multilayer Spiking Neural Networks With Spike Temporal Error Backpropagation

Fast and Accurate Classification with a Multi-Spike Learning Algorithm for Spiking Neurons.

S-TLLR: STDP-inspired Temporal Local Learning Rule for Spiking Neural Networks

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Training Spiking Neural Networks for Cognitive Tasks: A Versatile Framework Compatible with Various Temporal Codes.

Learning to Classify Faster Using Spiking Neural Networks

A Spiking Neural Network Model For Associative Memory Using Temporal Codes

Learning Real-World Stimuli By Single-Spike Coding And Tempotron Rule

BP-STDP: Approximating backpropagation using spike timing dependent plasticity

Temporal Surrogate Back-propagation for Spiking Neural Networks