Abstract:Artificial neural networks (ANNs), like convolutional neural networks (CNNs), have achieved the state-of-the-art results for many machine learning tasks. However, inference with large-scale full-precision CNNs must cause substantial energy consumption and memory occupation, which seriously hinders their deployment on mobile and embedded systems. Highly inspired from biological brain, spiking neural networks (SNNs) are emerging as new solutions because of natural superiority in brain-like learning and great energy efficiency with event-driven communication and computation. Nevertheless, training a deep SNN remains a main challenge and there is usually a big accuracy gap between ANNs and SNNs. In this paper, we introduce a hardware-friendly conversion algorithm called “scatter-and-gather” to convert quantized ANNs to lossless SNNs, where neurons are connected with ternary {−1,0,1} synaptic weights. Each spiking neuron is stateless and more like original McCulloch and Pitts model, because it fires at most one spike and need be reset at each time step. Furthermore, we develop an incremental mapping framework to demonstrate efficient network deployments on a reconfigurable neuromorphic chip. Experimental results show our spiking LeNet on MNIST and VGG-Net on CIFAR-10 datasetobtain 99.37% and 91.91% classification accuracy, respectively. Besides, the presented mapping algorithm manages network deployment on our neuromorphic chip with maximum resource efficiency and excellent flexibility. Our four-spike LeNet and VGG-Net on chip can achieve respective real-time inference speed of 0.38 ms/image, 3.24 ms/image, and an average power consumption of 0.28 mJ/image and 2.3 mJ/image at 0.9 V, 252 MHz, which is nearly two orders of magnitude more efficient than traditional GPUs.

A Power Efficient Hardware Implementation of the IF Neuron Model.

A Versatile Neuromorphic System Based on Simple Neuron Model

A Sparsity-Adapted Hardware Implementation of SNN for Cortical Spike Trains Decoding

A Hardware Implementation of SNN-Based Spatio-Temporal Memory Model.

A Systolic SNN Inference Accelerator and Its Co-optimized Software Framework

Power-efficient and Multiplier-less FPGA Implementation of Self-adaptive Leaky Integrate-and-Fire Neuron

Design and Performance Analysis of an Ultra-Low Power Integrate-and-Fire Neuron Circuit Using Nanoscale Side-contacted Field Effect Diode Technology

A Digital Neuromorphic Hardware for Spiking Neural Network

Hardware implementation of spiking neural networks on FPGA

A 64K-Neuron 64M-1b-Synapse 2.64pJ/SOP Neuromorphic Chip With All Memory on Chip for Spike-Based Models in 65nm CMOS

Ultra-Low Power Silicon Neuron Circuit for Extreme-Edge Neuromorphic Intelligence

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

Highly efficient neuromorphic learning system of spiking neural network with multi-compartment leaky integrate-and-fire neurons

Subthreshold CMOS Implementation of the Izhikevich Neuron Model

An Efficient FPGA Implementation of Izhikevich Neuron Model

An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification

55 Nm CMOS Mixed-Signal Neuromorphic Circuits for Constructing Energy-Efficient Reconfigurable SNNs

An 1.38nj/inference Clock-Free Mixed-Signal Neuromorphic Architecture Using ReL-PSP Function and Computing-in-Memory.

Single Flux Quantum Based Ultrahigh Speed Spiking Neuromorphic Processor Architecture

Computationally Efficient Low Power Neuron Model for Digital Brain

Implementation of a 12-Million Hodgkin-Huxley Neuron Network on a Single Chip