Abstract:Shifting computing architectures from von Neumann to event-based spiking neural networks (SNNs) uncovers new opportunities for low-power processing of sensory data in applications such as vision or sensorimotor control. Exploring roads toward cognitive SNNs requires the design of compact, low-power and versatile experimentation platforms with the key requirement of online learning in order to adapt and learn new features in uncontrolled environments. However, embedding online learning in SNNs is currently hindered by high incurred complexity and area overheads. In this work, we present ODIN, a 0.086-mm$^2$ 64k-synapse 256-neuron online-learning digital spiking neuromorphic processor in 28nm FDSOI CMOS achieving a minimum energy per synaptic operation (SOP) of 12.7pJ. It leverages an efficient implementation of the spike-driven synaptic plasticity (SDSP) learning rule for high-density embedded online learning with only 0.68$\mu$m$^2$ per 4-bit synapse. Neurons can be independently configured as a standard leaky integrate-and-fire (LIF) model or as a custom phenomenological model that emulates the 20 Izhikevich behaviors found in biological spiking neurons. Using a single presentation of 6k 16$\times$16 MNIST training images to a single-layer fully-connected 10-neuron network with on-chip SDSP-based learning, ODIN achieves a classification accuracy of 84.5% while consuming only 15nJ/inference at 0.55V using rank order coding. ODIN thus enables further developments toward cognitive neuromorphic devices for low-power, adaptive and low-cost processing.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to design a compact, low - power - consumption digital spiking neuromorphic processor with online learning ability, in order to adapt to and learn new features emerging in an uncontrolled environment. Specifically, the paper proposes a digital spiking neuromorphic processor named ODIN, which has the following characteristics: 1. **Online learning ability**: Traditional offline learning techniques rely on the repeated presentation of a large amount of training data, which is not suitable for autonomous agents that need to adapt to new features in real - time. ODIN embeds the online learning function in each synapse by implementing the Spike - Driven Synaptic Plasticity (SDSP) rule, enabling the processor to continuously learn and adapt in a real - time environment. 2. **High - density integration**: ODIN realizes 256 neurons and 64,000 synapses in a 28 - nm FDSOI CMOS process, and each 4 - bit synapse occupies an area of only 0.68 µm², demonstrating the ability of high - density integration. 3. **Biophysical accuracy and flexibility**: ODIN not only supports the standard Leaky Integrate - and - Fire (LIF) neuron model, but also supports custom phenomenological models and can simulate 20 Izhikevich behaviors, which are biologically significant. This flexibility enables ODIN to explore more complex computational properties. 4. **Low - power consumption**: The minimum energy consumption per Synaptic Operation (SOP) of ODIN at 0.55V is only 12.7 pJ, which gives it a significant advantage in low - power - consumption applications. 5. **Efficient time - multiplexing**: Through time - multiplexing technology, ODIN can effectively manage and update a large number of neuron and synapse states without parallel processing, thus saving silicon area and power consumption. The paper verifies the performance of ODIN through the MNIST handwritten digit classification task. Using a single presentation of 6,000 training images of 16×16 pixels, ODIN achieves a classification accuracy of 84.5% in a single - layer fully - connected 10 - neuron network, consuming only 15 nJ of energy per inference. In conclusion, this paper aims to promote the development of cognitive neuromorphic devices through the design and implementation of ODIN, enabling them to perform efficient information processing under the conditions of low - power consumption, self - adaptation, and low cost.

A 0.086-mm$^2$ 12.7-pJ/SOP 64k-Synapse 256-Neuron Online-Learning Digital Spiking Neuromorphic Processor in 28nm CMOS

Darwin:a Neuromorphic Hardware Co-Processor Based on Spiking Neural Networks

A 4096-Neuron 1M-Synapse 3.8-pJ/SOP Spiking Neural Network With On-Chip STDP Learning and Sparse Weights in 10-nm FinFET CMOS

A 45nm CMOS Neuromorphic Chip with a Scalable Architecture for Learning in Networks of Spiking Neurons

Analog Spiking Neuron in CMOS 28 nm Towards Large-Scale Neuromorphic Processors

A Spike-Event-Based Neuromorphic Processor with Enhanced On-Chip STDP Learning in 28nm CMOS

MorphIC: A 65-nm 738k-Synapse/mm$^2$ Quad-Core Binary-Weight Digital Neuromorphic Processor with Stochastic Spike-Driven Online Learning

A 64K-Neuron 64M-1b-Synapse 2.64pJ/SOP Neuromorphic Chip With All Memory on Chip for Spike-Based Models in 65nm CMOS

MorphBungee: A 65-nm 7.2-mm2 27-μJ/image Digital Edge Neuromorphic Chip with On-Chip 802-frame/s Multi-Layer Spiking Neural Network Learning

A 510 μW 0.738-mm 2 6.2-pJ/SOP Online Learning Multi-Topology SNN Processor With Unified Computation Engine in 40-nm CMOS

55 Nm CMOS Mixed-Signal Neuromorphic Circuits for Constructing Energy-Efficient Reconfigurable SNNs

NEXUS: A 28nm 3.3pJ/SOP 16-Core Spiking Neural Network with a Diamond Topology for Real-Time Data Processing

A Low-Power Spiking Neural Network Chip Based on a Compact LIF Neuron and Binary Exponential Charge Injector Synapse Circuits

30.2 A 22nm 0.26nW/Synapse Spike-Driven Spiking Neural Network Processing Unit Using Time-Step-First Dataflow and Sparsity-Adaptive In-Memory Computing

A CMOS Spiking Neuron for Brain-Inspired Neural Networks with Resistive Synapses and In-Situ Learning

An 1.38nj/inference Clock-Free Mixed-Signal Neuromorphic Architecture Using ReL-PSP Function and Computing-in-Memory.

EPOC: A 28-nm 5.3 pJ/SOP Event-driven Parallel Neuromorphic Hardware with Neuromodulation-based Online Learning

ANP-I: A 28-nm 1.5-pJ/SOP Asynchronous Spiking Neural Network Processor Enabling Sub-0.1-<inline-formula> <tex-math notation="LaTeX">$\mu $</tex-math> </inline-formula>J/Sample On-Chip Learning for Edge-AI Applications

22.6 ANP-I: A 28nm 1.5pJ/SOP Asynchronous Spiking Neural Network Processor Enabling Sub-O.1 μJ/Sample On-Chip Learning for Edge-AI Applications

A low cost neuromorphic learning engine based on a high performance supervised SNN learning algorithm

A 28-Nm 0.34-Pj/sop Spike-Based Neuromorphic Processor for Efficient Artificial Neural Network Implementations