Abstract:Spiking neural networks (SNNs) are the third generation of neural networks and can explore both rate and temporal coding for energy-efficient event-driven computation. However, the decision accuracy of existing SNN designs is contingent upon processing a large number of spikes over a long period. Nevertheless, the switching power of SNN hardware accelerators is proportional to the number of spikes processed while the length of spike trains limits throughput and static power efficiency. This paper presents the first study on developing temporal compression to significantly boost throughput and reduce energy dissipation of digital hardware SNN accelerators while being applicable to multiple spike codes. The proposed compression architectures consist of low-cost input spike compression units, novel input-and-output-weighted spiking neurons, and reconfigurable time constant scaling to support large and flexible time compression ratios. Our compression architectures can be transparently applied to any given pre-designed SNNs employing either rate or temporal codes while incurring minimal modification of the neural models, learning algorithms, and hardware design. Using spiking speech and image recognition datasets, we demonstrate the feasibility of supporting large time compression ratios of up to 16x, delivering up to 15.93x, 13.88x, and 86.21x improvements in throughput, energy dissipation, the tradeoffs between hardware area, runtime, energy, and classification accuracy, respectively based on different spike codes on a Xilinx Zynq-7000 FPGA. These results are achieved while incurring little extra hardware overhead.

An Efficient Spiking Neural Network Accelerator with Sparse Weight.

An Event-driven Spiking Neural Network Accelerator with On-chip Sparse Weight

A Convolutional Spiking Neural Network Accelerator with the Sparsity-Aware Memory and Compressed Weights

Efficient Structure Slimming for Spiking Neural Networks

ESSA: Design of a Programmable Efficient Sparse Spiking Neural Network Accelerator

Spike Trains Encoding Optimization for Spiking Neural Networks Implementation in FPGA

A Spiking Neural Network Accelerator based on Ping-Pong Architecture with Sparse Spike and Weight

A Reconfigurable FPGA-based Spiking Neural Network Accelerator

SPAT: FPGA-based Sparsity-Optimized Spiking Neural Network Training Accelerator with Temporal Parallel Dataflow

A 1.13μj/classification Spiking Neural Network Accelerator with a Single-Spike Neuron Model and Sparse Weights

Boosting Throughput and Efficiency of Hardware Spiking Neural Accelerators using Time Compression Supporting Multiple Spike Codes

SparseNN: A Performance-Efficient Accelerator for Large-Scale Sparse Neural Networks

Marmotini: A Weight Density Adaptation Architecture with Hybrid Compression Method for Spiking Neural Network

A Fast Spiking Neural Network Accelerator based on BP-STDP Algorithm and Weighted Neuron Model

Enabling Efficient On-Edge Spiking Neural Network Acceleration with Highly Flexible FPGA Architectures

A Low Power and Low Latency FPGA-Based Spiking Neural Network Accelerator

PULSE: Parametric Hardware Units for Low-power Sparsity-Aware Convolution Engine

Energy efficient spiking neural network processing using approximate arithmetic units and variable precision weights

An Energy-Efficient Spiking Neural Network Accelerator Based on Spatio-Temporal Redundancy Reduction

A Hybrid Heterogeneous Neural Network Accelerator Based on Systolic Array

A Sparsity-Adapted Hardware Implementation of SNN for Cortical Spike Trains Decoding