Abstract:Spiking neural networks (SNNs) have been witnessing the developing trends to reduce the model size and improve the hardware efficiency for area- and energy-based applications, which are processed by model pruning and data compressions. However, it is challenging to exploit the unstructured sparsity of SNNs for the dense neuromorphic processors. In this article, we present an efficient sparse SNN accelerator (ESSA), which leverages both the temporal sparsity of spike events and the spatial sparsity of weights in SNN inference. It provides both the compressed weights for sparse SNNs and the uncompressed weights for compact SNNs. The self-adaptive spike compression is proposed for sparse spike scenarios, leading to the improvement of throughput by $3.2\times $ . ESSA executes a flexible fan-in–fan-out tradeoff by using combinable dendrites, which overcomes the fan-in limitation in neuromorphic systems. Furthermore, a low-latency intrachip spike multicast method is adopted to reduce the resource overhead. Implemented on the Xilinx Kintex Ultrascale field-programmable gate array (FPGA), ESSA achieves an equivalent performance of 253.1 GSOP/s and an energy efficiency of 32.1 GSOP/W for 75% weight sparsity at 140 MHz. The implementation of a four-layer fully connected SNN is expected to perform $2.6~\mu \text{s}$ per time step and the energy consumption is $14.6~\mu \text{J}$ . Our results demonstrate that ESSA outperforms several state-of-the-art application-specific integrated circuit (ASIC) or FPGA neuromorphic processors.

A 1.13μj/classification Spiking Neural Network Accelerator with a Single-Spike Neuron Model and Sparse Weights

An Efficient Spiking Neural Network Accelerator with Sparse Weight.

Spike Trains Encoding Optimization for Spiking Neural Networks Implementation in FPGA

An Event-driven Spiking Neural Network Accelerator with On-chip Sparse Weight

A Convolutional Spiking Neural Network Accelerator with the Sparsity-Aware Memory and Compressed Weights

An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification

A Spiking Neural Network Accelerator based on Ping-Pong Architecture with Sparse Spike and Weight

A Low Power and Low Latency FPGA-Based Spiking Neural Network Accelerator

Spiking Neural Network Implementation on FPGA for Multiclass Classification

A Reconfigurable FPGA-based Spiking Neural Network Accelerator

Hardware implementation of spiking neural networks on FPGA

SPAT: FPGA-based Sparsity-Optimized Spiking Neural Network Training Accelerator with Temporal Parallel Dataflow

A Fast Spiking Neural Network Accelerator based on BP-STDP Algorithm and Weighted Neuron Model

Highly efficient neuromorphic learning system of spiking neural network with multi-compartment leaky integrate-and-fire neurons

A 0.67-to-5.4 TSOPs/W Spiking Neural Network Accelerator With 128/256 Reconfigurable Neurons and Asynchronous Fully Connected Synapses

ESSA: Design of a Programmable Efficient Sparse Spiking Neural Network Accelerator

Enabling Efficient On-Edge Spiking Neural Network Acceleration with Highly Flexible FPGA Architectures

A 4096-Neuron 1M-Synapse 3.8-pJ/SOP Spiking Neural Network With On-Chip STDP Learning and Sparse Weights in 10-nm FinFET CMOS

A 1024-Neuron 1M-Synapse Event-Driven SNN Accelerator for DVS Applications

An Asynchronous Reconfigurable SNN Accelerator with Event-Driven Time Step Update