Abstract:Artificial neural networks (ANNs), like convolutional neural networks (CNNs), have achieved the state-of-the-art results for many machine learning tasks. However, inference with large-scale full-precision CNNs must cause substantial energy consumption and memory occupation, which seriously hinders their deployment on mobile and embedded systems. Highly inspired from biological brain, spiking neural networks (SNNs) are emerging as new solutions because of natural superiority in brain-like learning and great energy efficiency with event-driven communication and computation. Nevertheless, training a deep SNN remains a main challenge and there is usually a big accuracy gap between ANNs and SNNs. In this paper, we introduce a hardware-friendly conversion algorithm called “scatter-and-gather” to convert quantized ANNs to lossless SNNs, where neurons are connected with ternary {−1,0,1} synaptic weights. Each spiking neuron is stateless and more like original McCulloch and Pitts model, because it fires at most one spike and need be reset at each time step. Furthermore, we develop an incremental mapping framework to demonstrate efficient network deployments on a reconfigurable neuromorphic chip. Experimental results show our spiking LeNet on MNIST and VGG-Net on CIFAR-10 datasetobtain 99.37% and 91.91% classification accuracy, respectively. Besides, the presented mapping algorithm manages network deployment on our neuromorphic chip with maximum resource efficiency and excellent flexibility. Our four-spike LeNet and VGG-Net on chip can achieve respective real-time inference speed of 0.38 ms/image, 3.24 ms/image, and an average power consumption of 0.28 mJ/image and 2.3 mJ/image at 0.9 V, 252 MHz, which is nearly two orders of magnitude more efficient than traditional GPUs.

An Asynchronous Reconfigurable SNN Accelerator with Event-Driven Time Step Update

A 0.67-to-5.4 TSOPs/W Spiking Neural Network Accelerator with 128/256 Reconfigurable Neurons and Asynchronous Fully Connected Synapses

A 28nm Configurable Asynchronous SNN Accelerator with Energy-Efficient Learning

An Asynchronous Multi-core Accelerator for SNN inference

SpiDR: A Reconfigurable Digital Compute-in-Memory Spiking Neural Network Accelerator for Event-based Perception

A Reconfigurable FPGA-based Spiking Neural Network Accelerator

A 1024-Neuron 1M-Synapse Event-Driven SNN Accelerator for DVS Applications

An Event-driven Spiking Neural Network Accelerator with On-chip Sparse Weight

A Convolutional Spiking Neural Network Accelerator with the Sparsity-Aware Memory and Compressed Weights

A Low Power and Low Latency FPGA-Based Spiking Neural Network Accelerator

30.2 A 22nm 0.26nW/Synapse Spike-Driven Spiking Neural Network Processing Unit Using Time-Step-First Dataflow and Sparsity-Adaptive In-Memory Computing

Multicore Spiking Neuromorphic Chip in 180-nm with ReRAM Synapses and Digital Neurons

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

FSNAP: an Ultra-Energy-Efficient Few-Spikes-Neuron Based Reconfigurable SNN Processor Enabling Unified On-Chip Learning and Accuracy-Driven Adaptive Time-Window Tuning

A Hybrid Heterogeneous Neural Network Accelerator Based on Systolic Array

A Spiking Neural Network Accelerator based on Ping-Pong Architecture with Sparse Spike and Weight

ESSA: Design of a Programmable Efficient Sparse Spiking Neural Network Accelerator

A 1.13μj/classification Spiking Neural Network Accelerator with a Single-Spike Neuron Model and Sparse Weights

Hardware-Software Co-optimised Fast and Accurate Deep Reconfigurable Spiking Inference Accelerator Architecture Design Methodology

SPAT: FPGA-based Sparsity-Optimized Spiking Neural Network Training Accelerator with Temporal Parallel Dataflow