Abstract:Implementing neural networks (NN) on edge devices enables AI to be applied in many daily scenarios. The stringent area and power budget on edge devices impose challenges on conventional NNs with massive energy-consuming Multiply Accumulation (MAC) operations and offer an opportunity for Spiking Neural Networks (SNN), which can be implemented within sub-mW power budget. However, mainstream SNN topologies varies from Spiking Feedforward Neural Network (SFNN), Spiking Recurrent Neural Network (SRNN), to Spiking Convolutional Neural Network (SCNN), and it is challenging for the edge SNN processor to adapt to different topologies. Besides, online learning ability is critical for edge devices to adapt to local environments but comes with dedicated learning modules, further increasing area and power consumption burdens. To alleviate these problems, this work proposed RAINE, a reconfigurable neuromorphic engine supporting multiple SNN topologies and a dedicated trace-based rewarded spike-timing-dependent plasticity (TR-STDP) learning algorithm. Sixteen Unified-Dynamics Learning-Engines (UDLEs) are implemented in RAINE to realize a compact and reconfigurable implementation of different SNN operations. Three topology-aware data reuse strategies are proposed and analyzed to optimize the mapping of different SNNs on RAINE. A 40-nm prototype chip is fabricated, achieving energy-per-synaptic-operation (SOP) of 6.2 pJ/SOP at 0.51 V, and power consumption of 510 μW at 0.45 V. Finally, three examples with different SNN topologies, including SRNN-based ECG arrhythmia detection, SCNN-based 2D image classification, and end-to-end on-chip learning for MNIST digit recognition, are demonstrated on RAINE with ultra-low energy consumption of 97.7nJ/step, 6.28 μJ/sample, and 42.98 μJ/sample respectively. These results show the feasibility of obtaining high reconfigurability and low power consumption simultaneously on a SNN processor.

1.63 Pj/sop Neuromorphic Processor with Integrated Partial Sum Routers for In-Network Computing

A 3.89-Gops/mw Scalable Recurrent Neural Network Processor with Improved Efficiency on Memory and Computation

A 0.96pJ/SOP, 30.23K-neuron/mm^2 Heterogeneous Neuromorphic Chip With Fullerene-like Interconnection Topology for Edge-AI Computing

55 Nm CMOS Mixed-Signal Neuromorphic Circuits for Constructing Energy-Efficient Reconfigurable SNNs

A 0.99-to-4.38 Uj/class Event-Driven Hybrid Neural Network Processor for Full-Spectrum Neural Signal Analyses

PAICORE: A 1.9-Million-neuron 5.181-TSOPS/W Digital Neuromorphic Processor with Unified SNN-ANN and On-Chip Learning Paradigm

A 28-Nm 0.34-Pj/sop Spike-Based Neuromorphic Processor for Efficient Artificial Neural Network Implementations

UIC: A Unified and Scalable Chip Integrating Neuromorphic Computation and General Purpose Processor

A High Energy-Efficiency Multi-core Neuromorphic Architecture for Deep SNN Training

Multicore Spiking Neuromorphic Chip in 180-nm with ReRAM Synapses and Digital Neurons

An 1.38nj/inference Clock-Free Mixed-Signal Neuromorphic Architecture Using ReL-PSP Function and Computing-in-Memory.

Core interface optimization for multi-core neuromorphic processors

Design and Performance Analysis of an Ultra-Low Power Integrate-and-Fire Neuron Circuit Using Nanoscale Side-contacted Field Effect Diode Technology

An Ultra-Low Latency Multicast Router for Large-Scale Multi-Chip Neuromorphic Processing

An Energy-Efficient Computing-in-Memory Neuromorphic System with On-Chip Training.

RISC-V Toolchain and Agile Development based Open-source Neuromorphic Processor

Open the box of digital neuromorphic processor: Towards effective algorithm-hardware co-design

Single Flux Quantum Based Ultrahigh Speed Spiking Neuromorphic Processor Architecture

Neural Synaptic Plasticity-Inspired Computing: A High Computing Efficient Deep Convolutional Neural Network Accelerator

A 510 μW 0.738-mm 2 6.2-pJ/SOP Online Learning Multi-Topology SNN Processor With Unified Computation Engine in 40-nm CMOS

Optimizing event-based neural networks on digital neuromorphic architecture: a comprehensive design space exploration