Abstract:Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remain a challenging problem. In this article, we make our contributions toward this direction. A simplified spiking neuron model is first introduced with the effects of both synaptic input and firing output on the membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multispike learning rules which demonstrate better performance over other baselines on various tasks, including association, classification, and feature detection. In addition to efficiency, our learning rules demonstrate high robustness against the strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably, the single neuron is capable of solving multicategory classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised spike-timing-dependent plasticity with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules cannot only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.

Self-Evolutionary Neuron Model for Fast-Response Spiking Neural Networks

Fast and Efficient Asynchronous Neural Computation with Adapting Spiking Neural Networks

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning

Spiking Deep Residual Networks.

Fast and Accurate Classification with a Multi-Spike Learning Algorithm for Spiking Neurons.

Adaptive Smoothing Gradient Learning for Spiking Neural Networks.

Effective Active Learning Method for Spiking Neural Networks.

Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Toward High-Accuracy and Low-Latency Spiking Neural Networks With Two-Stage Optimization

Training a General Spiking Neural Network with Improved Efficiency and Minimum Latency

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Neurogenesis Dynamics-inspired Spiking Neural Network Training Acceleration

Fast-SNN: Fast Spiking Neural Network by Converting Quantized ANN

Improving Spiking Neural Network With Frequency Adaptation for Image Classification

Evolving Efficient Genetic Encoding for Deep Spiking Neural Networks

Robust and accelerated single-spike spiking neural network training with applicability to challenging temporal tasks