Abstract:Artificial neural networks (ANNs), like convolutional neural networks (CNNs), have achieved the state-of-the-art results for many machine learning tasks. However, inference with large-scale full-precision CNNs must cause substantial energy consumption and memory occupation, which seriously hinders their deployment on mobile and embedded systems. Highly inspired from biological brain, spiking neural networks (SNNs) are emerging as new solutions because of natural superiority in brain-like learning and great energy efficiency with event-driven communication and computation. Nevertheless, training a deep SNN remains a main challenge and there is usually a big accuracy gap between ANNs and SNNs. In this paper, we introduce a hardware-friendly conversion algorithm called “scatter-and-gather” to convert quantized ANNs to lossless SNNs, where neurons are connected with ternary {−1,0,1} synaptic weights. Each spiking neuron is stateless and more like original McCulloch and Pitts model, because it fires at most one spike and need be reset at each time step. Furthermore, we develop an incremental mapping framework to demonstrate efficient network deployments on a reconfigurable neuromorphic chip. Experimental results show our spiking LeNet on MNIST and VGG-Net on CIFAR-10 datasetobtain 99.37% and 91.91% classification accuracy, respectively. Besides, the presented mapping algorithm manages network deployment on our neuromorphic chip with maximum resource efficiency and excellent flexibility. Our four-spike LeNet and VGG-Net on chip can achieve respective real-time inference speed of 0.38 ms/image, 3.24 ms/image, and an average power consumption of 0.28 mJ/image and 2.3 mJ/image at 0.9 V, 252 MHz, which is nearly two orders of magnitude more efficient than traditional GPUs.

A Burst-Dependent Algorithm for Neuromorphic On-Chip Learning of Spiking Neural Networks

An error-propagation spiking neural network compatible with neuromorphic processors

Efficient Spike-Driven Learning With Dendritic Event-Based Processing

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware

Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikes

A Spiking Network for Inference of Relations Trained with Neuromorphic Backpropagation

Improving classification accuracy of feedforward neural networks for spiking neuromorphic chips

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

Event-Driven Learning for Spiking Neural Networks

An Efficient Neuromorphic Implementation of Temporal Coding-Based On-Chip STDP Learning

Single-phase deep learning in cortico-cortical networks

Scalable NoC-based Neuromorphic Hardware Learning and Inference

Towards On-Chip Bayesian Neuromorphic Learning

A Neuromorphic-Hardware Oriented Bio-Plausible Online-Learning Spiking Neural Network Model.

Efficient Implementation of Spiking Neural Networks for Inference Using Ex-Situ Training

Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

NbO2 Memristive Neurons for Burst-Based Perceptron

Binary Resistive-Switching-Device-Based Electronic Synapse with Spike-Rate-Dependent Plasticity for Online Learning

Generation and Application of Bursting Dynamic Behaviour in Memristor Neurons.