Abstract:Artificial neural networks (ANNs), like convolutional neural networks (CNNs), have achieved the state-of-the-art results for many machine learning tasks. However, inference with large-scale full-precision CNNs must cause substantial energy consumption and memory occupation, which seriously hinders their deployment on mobile and embedded systems. Highly inspired from biological brain, spiking neural networks (SNNs) are emerging as new solutions because of natural superiority in brain-like learning and great energy efficiency with event-driven communication and computation. Nevertheless, training a deep SNN remains a main challenge and there is usually a big accuracy gap between ANNs and SNNs. In this paper, we introduce a hardware-friendly conversion algorithm called “scatter-and-gather” to convert quantized ANNs to lossless SNNs, where neurons are connected with ternary {−1,0,1} synaptic weights. Each spiking neuron is stateless and more like original McCulloch and Pitts model, because it fires at most one spike and need be reset at each time step. Furthermore, we develop an incremental mapping framework to demonstrate efficient network deployments on a reconfigurable neuromorphic chip. Experimental results show our spiking LeNet on MNIST and VGG-Net on CIFAR-10 datasetobtain 99.37% and 91.91% classification accuracy, respectively. Besides, the presented mapping algorithm manages network deployment on our neuromorphic chip with maximum resource efficiency and excellent flexibility. Our four-spike LeNet and VGG-Net on chip can achieve respective real-time inference speed of 0.38 ms/image, 3.24 ms/image, and an average power consumption of 0.28 mJ/image and 2.3 mJ/image at 0.9 V, 252 MHz, which is nearly two orders of magnitude more efficient than traditional GPUs.

D-SELD: Dataset-Scalable Exemplar LCA-Decoder

A Sparsity-Adapted Hardware Implementation of SNN for Cortical Spike Trains Decoding

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Multi-LRA: Multi Logical Residual Architecture for Spiking Neural Networks

A Spiking Neural Network Decoder for Implantable Brain Machine Interfaces and its Sparsity-aware Deployment on RISC-V Microcontrollers

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition

Sparse Coding in a Dual Memory System for Lifelong Learning

Direct Training for Spiking Neural Networks: Faster, Larger, Better

Training Energy-Efficient Deep Spiking Neural Networks with Single-Spike Hybrid Input Encoding

BioLCNet: Reward-modulated Locally Connected Spiking Neural Networks

Scalable NoC-based Neuromorphic Hardware Learning and Inference

EvSegSNN: Neuromorphic Semantic Segmentation for Event Data

Exploring the Sparsity-Quantization Interplay on a Novel Hybrid SNN Event-Driven Architecture

Accurate and Efficient Event-based Semantic Segmentation Using Adaptive Spiking Encoder-Decoder Network

Supervised Learning with First-to-Spike Decoding in Multilayer Spiking Neural Networks

Temporal-Coded Deep Spiking Neural Network with Easy Training and Robust Performance.

Fast and Accurate Sparse Coding of Visual Stimuli With a Simple, Ultralow-Energy Spiking Architecture

High-performance deep spiking neural networks via at-most-two-spike exponential coding