Abstract:Spiking neural networks (SNNs) are promising alternatives to artificial neural networks (ANNs) since they are more realistic brain-inspired computing models. SNNs have sparse neuron firing over time, i.e., spatiotemporal sparsity; thus, they are helpful in enabling energy-efficient hardware inference. However, exploiting the spatiotemporal sparsity of SNNs in hardware leads to unpredictable and unbalanced workloads, degrading the energy efficiency. Compared to SNNs with simple fully connected structures, those extensive structures (e.g., standard convolutions, depthwise convolutions, and pointwise convolutions) can deal with more complicated tasks but lead to difficulties in hardware mapping. In this work, we propose a novel reconfigurable architecture, Cerebron, which can fully exploit the spatiotemporal sparsity in SNNs with maximized data reuse and propose optimization techniques to improve the efficiency and flexibility of the hardware. To achieve flexibility, the reconfigurable compute engine is compatible with a variety of spiking layers and supports inter-computing-unit (CU) and intra-CU reconfiguration. The compute engine can exploit data reuse and guarantee parallel data access when processing different convolutions to achieve memory efficiency. A two-step data sparsity exploitation method is introduced to leverage the sparsity of discrete spikes and reduce the computation time. Besides, an online channelwise workload scheduling strategy is designed to reduce the latency further. Cerebron is verified on image segmentation and classification tasks using a variety of state-of-the-art spiking network structures. Experimental results show that Cerebron has achieved at least $17.5\times $ prediction energy reduction and $20\times $ speedup compared with state-of-the-art field-programmable gate array (FPGA)-based accelerators.

A Configurable Spiking Convolution Architecture Supporting Multiple Coding Schemes on FPGA

A Resource-Efficient Scalable Spiking Neural Network Hardware Architecture with Reusable Modules and Memory Reutilization

Spike Trains Encoding Optimization for Spiking Neural Networks Implementation in FPGA

A Cost-Efficient High-Speed VLSI Architecture for Spiking Convolutional Neural Network Inference Using Time-Step Binary Spike Maps

A Sparsity-Adapted Hardware Implementation of SNN for Cortical Spike Trains Decoding

Boosting Throughput and Efficiency of Hardware Spiking Neural Accelerators using Time Compression Supporting Multiple Spike Codes

An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification

A Case for Spiking Neural Network Simulation Based on Configurable Multiple-Fpga Systems

FPGA-Based Implementation of an Event-Driven Spiking Multi-Kernel Convolution Architecture

A Reconfigurable FPGA-based Spiking Neural Network Accelerator

A 0.67-to-5.4 TSOPs/W Spiking Neural Network Accelerator with 128/256 Reconfigurable Neurons and Asynchronous Fully Connected Synapses

Spiking Neural Network Implementation on FPGA for Multiclass Classification

A Spiking Neural Network Accelerator based on Ping-Pong Architecture with Sparse Spike and Weight

Hardware-Software Co-optimised Fast and Accurate Deep Reconfigurable Spiking Inference Accelerator Architecture Design Methodology

ESSA: Design of a Programmable Efficient Sparse Spiking Neural Network Accelerator

Hardware implementation of spiking neural networks on FPGA

An AER-based spiking convolution neural network system for image classification with low latency and high energy efficiency

Cerebron: A Reconfigurable Architecture for Spatiotemporal Sparse Spiking Neural Networks

Efficient Neuron Architecture for Fpga-Based Spiking Neural Networks

A Convolutional Spiking Neural Network Accelerator with the Sparsity-Aware Memory and Compressed Weights