Abstract:Artificial neural networks (ANNs), like convolutional neural networks (CNNs), have achieved the state-of-the-art results for many machine learning tasks. However, inference with large-scale full-precision CNNs must cause substantial energy consumption and memory occupation, which seriously hinders their deployment on mobile and embedded systems. Highly inspired from biological brain, spiking neural networks (SNNs) are emerging as new solutions because of natural superiority in brain-like learning and great energy efficiency with event-driven communication and computation. Nevertheless, training a deep SNN remains a main challenge and there is usually a big accuracy gap between ANNs and SNNs. In this paper, we introduce a hardware-friendly conversion algorithm called “scatter-and-gather” to convert quantized ANNs to lossless SNNs, where neurons are connected with ternary {−1,0,1} synaptic weights. Each spiking neuron is stateless and more like original McCulloch and Pitts model, because it fires at most one spike and need be reset at each time step. Furthermore, we develop an incremental mapping framework to demonstrate efficient network deployments on a reconfigurable neuromorphic chip. Experimental results show our spiking LeNet on MNIST and VGG-Net on CIFAR-10 datasetobtain 99.37% and 91.91% classification accuracy, respectively. Besides, the presented mapping algorithm manages network deployment on our neuromorphic chip with maximum resource efficiency and excellent flexibility. Our four-spike LeNet and VGG-Net on chip can achieve respective real-time inference speed of 0.38 ms/image, 3.24 ms/image, and an average power consumption of 0.28 mJ/image and 2.3 mJ/image at 0.9 V, 252 MHz, which is nearly two orders of magnitude more efficient than traditional GPUs.

An End-to-End SoC for Brain-Inspired CNN-SNN Hybrid Applications

DaDianNao: A Machine-Learning Supercomputer

A Cost-Efficient High-Speed VLSI Architecture for Spiking Convolutional Neural Network Inference Using Time-Step Binary Spike Maps

Spike Trains Encoding Optimization for Spiking Neural Networks Implementation in FPGA

An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification

A Hybrid Heterogeneous Neural Network Accelerator Based on Systolic Array

A High Energy-Efficiency Multi-core Neuromorphic Architecture for Deep SNN Training

A Systolic SNN Inference Accelerator and Its Co-optimized Software Framework

A 0.67-to-5.4 TSOPs/W Spiking Neural Network Accelerator with 128/256 Reconfigurable Neurons and Asynchronous Fully Connected Synapses

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

NBSSN: A Neuromorphic Binary Single-Spike Neural Network for Efficient Edge Intelligence.

A Resource-Efficient Scalable Spiking Neural Network Hardware Architecture with Reusable Modules and Memory Reutilization

Marmotini: A Weight Density Adaptation Architecture with Hybrid Compression Method for Spiking Neural Network

Modular Building Blocks for Mapping Spiking Neural Networks Onto a Programmable Neuromorphic Processor

A Low Power and Low Latency FPGA-Based Spiking Neural Network Accelerator

Hardware implementation of spiking neural networks on FPGA

NEXUS: A 28nm 3.3pJ/SOP 16-Core Spiking Neural Network with a Diamond Topology for Real-Time Data Processing

Enabling Efficient On-Edge Spiking Neural Network Acceleration with Highly Flexible FPGA Architectures

TripleBrain: An Edge Neuromorphic Architecture for High-accuracy Single-layer Spiking Neural Network with On-chip Self-organizing and Reinforcement Learning

Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition