Abstract:Artificial neural networks (ANNs), like convolutional neural networks (CNNs), have achieved the state-of-the-art results for many machine learning tasks. However, inference with large-scale full-precision CNNs must cause substantial energy consumption and memory occupation, which seriously hinders their deployment on mobile and embedded systems. Highly inspired from biological brain, spiking neural networks (SNNs) are emerging as new solutions because of natural superiority in brain-like learning and great energy efficiency with event-driven communication and computation. Nevertheless, training a deep SNN remains a main challenge and there is usually a big accuracy gap between ANNs and SNNs. In this paper, we introduce a hardware-friendly conversion algorithm called “scatter-and-gather” to convert quantized ANNs to lossless SNNs, where neurons are connected with ternary {−1,0,1} synaptic weights. Each spiking neuron is stateless and more like original McCulloch and Pitts model, because it fires at most one spike and need be reset at each time step. Furthermore, we develop an incremental mapping framework to demonstrate efficient network deployments on a reconfigurable neuromorphic chip. Experimental results show our spiking LeNet on MNIST and VGG-Net on CIFAR-10 datasetobtain 99.37% and 91.91% classification accuracy, respectively. Besides, the presented mapping algorithm manages network deployment on our neuromorphic chip with maximum resource efficiency and excellent flexibility. Our four-spike LeNet and VGG-Net on chip can achieve respective real-time inference speed of 0.38 ms/image, 3.24 ms/image, and an average power consumption of 0.28 mJ/image and 2.3 mJ/image at 0.9 V, 252 MHz, which is nearly two orders of magnitude more efficient than traditional GPUs.

A Novel Conversion Method for Spiking Neural Network Using Median Quantization

Constructing Lightweight and Efficient Spiking Neural Networks for EEG-based Motor Imagery Classification

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks

Low Precision Quantization-aware Training in Spiking Neural Networks with Differentiable Quantization Function

High-accuracy deep ANN-to-SNN conversion using quantization-aware training framework and calcium-gated bipolar leaky integrate and fire neuron

Fast-SNN: Fast Spiking Neural Network by Converting Quantized ANN

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

Quantization Framework for Fast Spiking Neural Networks

Toward High-Accuracy and Low-Latency Spiking Neural Networks With Two-Stage Optimization

Deep Spiking Neural Networks with Binary Weights for Object Recognition

Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikes

Toward a Lossless Conversion for Spiking Neural Networks with Negative-Spike Dynamics.

Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs

Spike Calibration: Bridging the Gap between ANNs and SNNs in ANN-SNN Conversion

SpikeConverter: an Efficient Conversion Framework Zipping the Gap Between Artificial Neural Networks and Spiking Neural Networks

Towards Lossless ANN-SNN Conversion under Ultra-Low Latency with Dual-Phase Optimization

A New ANN-SNN Conversion Method with High Accuracy, Low Latency and Good Robustness

Efficient Converted Spiking Neural Network for 3D and 2D Classification

Optimized Potential Initialization for Low-latency Spiking Neural Networks

A universal ANN-to-SNN framework for achieving high accuracy and low latency deep Spiking Neural Networks