Abstract:Spiking neural networks (SNNs) are promising alternatives to artificial neural networks (ANNs) since they are more realistic brain-inspired computing models. SNNs have sparse neuron firing over time, i.e., spatiotemporal sparsity; thus, they are helpful in enabling energy-efficient hardware inference. However, exploiting the spatiotemporal sparsity of SNNs in hardware leads to unpredictable and unbalanced workloads, degrading the energy efficiency. Compared to SNNs with simple fully connected structures, those extensive structures (e.g., standard convolutions, depthwise convolutions, and pointwise convolutions) can deal with more complicated tasks but lead to difficulties in hardware mapping. In this work, we propose a novel reconfigurable architecture, Cerebron, which can fully exploit the spatiotemporal sparsity in SNNs with maximized data reuse and propose optimization techniques to improve the efficiency and flexibility of the hardware. To achieve flexibility, the reconfigurable compute engine is compatible with a variety of spiking layers and supports inter-computing-unit (CU) and intra-CU reconfiguration. The compute engine can exploit data reuse and guarantee parallel data access when processing different convolutions to achieve memory efficiency. A two-step data sparsity exploitation method is introduced to leverage the sparsity of discrete spikes and reduce the computation time. Besides, an online channelwise workload scheduling strategy is designed to reduce the latency further. Cerebron is verified on image segmentation and classification tasks using a variety of state-of-the-art spiking network structures. Experimental results show that Cerebron has achieved at least $17.5\times $ prediction energy reduction and $20\times $ speedup compared with state-of-the-art field-programmable gate array (FPGA)-based accelerators.

Algorithm/Architecture of NN-Based Configuration Prefetching

Efficient Hardware Configuration Method for Photonic Neural Network with Genetic Algorithm

A 3.89-Gops/mw Scalable Recurrent Neural Network Processor with Improved Efficiency on Memory and Computation

Run-time configuration prefetching to reduce the overhead of dynamically reconfiguration

CCP: Configuration Context Based Prefetching to Improve Coarse-Grained Reconfigurable Array Performance.

Attention, Distillation, and Tabularization: Towards Practical Neural Network-Based Prefetching

A Reduced Architecture for ReRAM-Based Neural Network Accelerator and Its Software Stack

Data Cache Prefetching with Perceptron Learning

Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit

Architectural Implications of Neural Network Inference for High Data-Rate, Low-Latency Scientific Applications

SFANC: Scalable and Flexible Architecture for Neuromorphic Computing

Reconfigurable Neural Synaptic Plasticity-Based Stochastic Deep Neural Network Computing

FSNAP: an Ultra-Energy-Efficient Few-Spikes-Neuron Based Reconfigurable SNN Processor Enabling Unified On-Chip Learning and Accuracy-Driven Adaptive Time-Window Tuning

Cerebron: A Reconfigurable Architecture for Spatiotemporal Sparse Spiking Neural Networks

Rna: A Reconfigurable Architecture for Hardware Neural Acceleration

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

RL-CoPref: a reinforcement learning-based coordinated prefetching controller for multiple prefetchers

FPSA: A Full System Stack Solution for Reconfigurable ReRAM-based NN Accelerator Architecture

Efficient Neural Networks on the Edge with FPGAs by Optimizing an Adaptive Activation Function

A Power-Aware Hybrid Cache for Chip-Multi Processors Based on Neural Network Prediction Technique

Reconfigurable neuromorphic computing block through integration of flash synapse arrays and super-steep neurons