Abstract:Spiking neural networks (SNNs) are promising alternatives to artificial neural networks (ANNs) since they are more realistic brain-inspired computing models. SNNs have sparse neuron firing over time, i.e., spatiotemporal sparsity; thus, they are helpful in enabling energy-efficient hardware inference. However, exploiting the spatiotemporal sparsity of SNNs in hardware leads to unpredictable and unbalanced workloads, degrading the energy efficiency. Compared to SNNs with simple fully connected structures, those extensive structures (e.g., standard convolutions, depthwise convolutions, and pointwise convolutions) can deal with more complicated tasks but lead to difficulties in hardware mapping. In this work, we propose a novel reconfigurable architecture, Cerebron, which can fully exploit the spatiotemporal sparsity in SNNs with maximized data reuse and propose optimization techniques to improve the efficiency and flexibility of the hardware. To achieve flexibility, the reconfigurable compute engine is compatible with a variety of spiking layers and supports inter-computing-unit (CU) and intra-CU reconfiguration. The compute engine can exploit data reuse and guarantee parallel data access when processing different convolutions to achieve memory efficiency. A two-step data sparsity exploitation method is introduced to leverage the sparsity of discrete spikes and reduce the computation time. Besides, an online channelwise workload scheduling strategy is designed to reduce the latency further. Cerebron is verified on image segmentation and classification tasks using a variety of state-of-the-art spiking network structures. Experimental results show that Cerebron has achieved at least $17.5\times $ prediction energy reduction and $20\times $ speedup compared with state-of-the-art field-programmable gate array (FPGA)-based accelerators.

Memory-Efficient Reversible Spiking Neural Networks

High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Spiking Deep Residual Networks.

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

Advancing Spiking Neural Networks Toward Deep Residual Learning

Cerebron: A Reconfigurable Architecture for Spatiotemporal Sparse Spiking Neural Networks

Sharing Leaky-Integrate-and-Fire Neurons for Memory-Efficient Spiking Neural Networks

Reconsidering the energy efficiency of spiking neural networks

Reversible Recurrent Neural Networks

Memristor-based Deep Spiking Neural Network with a Computing-In-Memory Architecture

A Memristor-Based Spiking Neural Network With High Scalability and Learning Efficiency

You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy

Spiking Deep Residual Network

A Resource-Efficient Scalable Spiking Neural Network Hardware Architecture with Reusable Modules and Memory Reutilization

Multicore Spiking Neuromorphic Chip in 180-nm with ReRAM Synapses and Digital Neurons

Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks

Computing of temporal information in spiking neural networks with ReRAM synapses

In-situ Learning in Hardware Compatible Multi-layer Memristive Spiking Neural Network

Training a General Spiking Neural Network with Improved Efficiency and Minimum Latency

SNN2ANN: A Fast and Memory-Efficient Training Framework for Spiking Neural Networks