Abstract:Spiking Neural Networks (SNNs) operate with asynchronous discrete events (or spikes) which can potentially lead to higher energy-efficiency in neuromorphic hardware implementations. Many works have shown that an SNN for inference can be formed by copying the weights from a trained Artificial Neural Network (ANN) and setting the firing threshold for each layer as the maximum input received in that layer. These type of converted SNNs require a large number of time steps to achieve competitive accuracy which diminishes the energy savings. The number of time steps can be reduced by training SNNs with spike-based backpropagation from scratch, but that is computationally expensive and slow. To address these challenges, we present a computationally-efficient training technique for deep SNNs. We propose a hybrid training methodology: 1) take a converted SNN and use its weights and thresholds as an initialization step for spike-based backpropagation, and 2) perform incremental spike-timing dependent backpropagation (STDB) on this carefully initialized network to obtain an SNN that converges within few epochs and requires fewer time steps for input processing. STDB is performed with a novel surrogate gradient function defined using neuron's spike time. The proposed training methodology converges in less than 20 epochs of spike-based backpropagation for most standard image classification datasets, thereby greatly reducing the training complexity compared to training SNNs from scratch. We perform experiments on CIFAR-10, CIFAR-100, and ImageNet datasets for both VGG and ResNet architectures. We achieve top-1 accuracy of 65.19% for ImageNet dataset on SNN with 250 time steps, which is 10X faster compared to converted SNNs with similar accuracy.

Low Latency Spiking ConvNets with Restricted Output Training and False Spike Inhibition

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

Toward High-Accuracy and Low-Latency Spiking Neural Networks With Two-Stage Optimization

Spiking Deep Residual Networks.

Optimized Potential Initialization for Low-latency Spiking Neural Networks

Can Deep Neural Networks be Converted to Ultra Low-Latency Spiking Neural Networks?

A Stage-wise Conversion Strategy for Low-Latency Deformable Spiking CNN

Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikes

Toward a Lossless Conversion for Spiking Neural Networks with Negative-Spike Dynamics.

Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation

A Little Energy Goes a Long Way: Build an Energy-Efficient, Accurate Spiking Neural Network From Convolutional Neural Network

Deep Spiking Neural Networks with Binary Weights for Object Recognition

Towards Lossless ANN-SNN Conversion under Ultra-Low Latency with Dual-Phase Optimization

Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks

Fast and Efficient Deep Sparse Multi-Strength Spiking Neural Networks with Dynamic Pruning.

Spike Calibration: Fast and Accurate Conversion of Spiking Neural Network for Object Detection and Segmentation

Training a General Spiking Neural Network with Improved Efficiency and Minimum Latency

Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs

Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks

Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks

Spike Calibration: Bridging the Gap between ANNs and SNNs in ANN-SNN Conversion