Abstract:Spiking Neural Networks (SNNs) operate with asynchronous discrete events (or spikes) which can potentially lead to higher energy-efficiency in neuromorphic hardware implementations. Many works have shown that an SNN for inference can be formed by copying the weights from a trained Artificial Neural Network (ANN) and setting the firing threshold for each layer as the maximum input received in that layer. These type of converted SNNs require a large number of time steps to achieve competitive accuracy which diminishes the energy savings. The number of time steps can be reduced by training SNNs with spike-based backpropagation from scratch, but that is computationally expensive and slow. To address these challenges, we present a computationally-efficient training technique for deep SNNs. We propose a hybrid training methodology: 1) take a converted SNN and use its weights and thresholds as an initialization step for spike-based backpropagation, and 2) perform incremental spike-timing dependent backpropagation (STDB) on this carefully initialized network to obtain an SNN that converges within few epochs and requires fewer time steps for input processing. STDB is performed with a novel surrogate gradient function defined using neuron's spike time. The proposed training methodology converges in less than 20 epochs of spike-based backpropagation for most standard image classification datasets, thereby greatly reducing the training complexity compared to training SNNs from scratch. We perform experiments on CIFAR-10, CIFAR-100, and ImageNet datasets for both VGG and ResNet architectures. We achieve top-1 accuracy of 65.19% for ImageNet dataset on SNN with 250 time steps, which is 10X faster compared to converted SNNs with similar accuracy.

Homeostasis-Based Cnn-To-Snn Conversion Of Inception And Residual Architectures

Spiking Deep Residual Networks.

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

SpikeConverter: an Efficient Conversion Framework Zipping the Gap Between Artificial Neural Networks and Spiking Neural Networks

Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs

A universal ANN-to-SNN framework for achieving high accuracy and low latency deep Spiking Neural Networks

Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks

BSNN: Towards faster and better conversion of artificial neural networks to spiking neural networks with bistable neurons

Deep Spiking Neural Networks with Binary Weights for Object Recognition

High-accuracy deep ANN-to-SNN conversion using quantization-aware training framework and calcium-gated bipolar leaky integrate and fire neuron

A Little Energy Goes a Long Way: Build an Energy-Efficient, Accurate Spiking Neural Network From Convolutional Neural Network

Toward High-Accuracy and Low-Latency Spiking Neural Networks With Two-Stage Optimization

Obtaining Optimal Spiking Neural Network in Sequence Learning via CRNN-SNN Conversion

Spiking Deep Residual Network

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation

Low Latency Spiking ConvNets with Restricted Output Training and False Spike Inhibition

Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks

Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks