Abstract:In recent years, the scaling down that Moore’s Law relies on has been gradually slowing down, and the traditional von Neumann architecture has been limiting the improvement of computing power. Thus, neuromorphic in-memory computing hardware has been proposed and is becoming a promising alternative. However, there is still a long way to make it possible, and one of the problems is to provide an efficient, reliable, and achievable neural network for hardware implementation. In this paper, we proposed a two-layer fully connected spiking neural network based on binary MRAM (Magneto-resistive Random Access Memory) synapses with low hardware cost. First, the network used an array of multiple binary MRAM cells to store multi-bit fixed-point weight values. This helps to simplify the read/write circuit. Second, we used different kinds of spike encoders that ensure the sparsity of input spikes, to reduce the complexity of peripheral circuits, such as sense amplifiers. Third, we designed a single-step learning rule, which fit well with the fixed-point binary weights. Fourth, we replaced the traditional exponential Leak-Integrate-Fire (LIF) neuron model to avoid the massive cost of exponential circuits. The simulation results showed that, compared to other similar works, our SNN with 1184 neurons and 313,600 synapses achieved an accuracy of up to 90.6% in the MNIST recognition task with full-resolution (28 × 28) and full-bit-depth (8-bit) images. In the case of low-resolution (16 × 16) and black-white (1-bit) images, the smaller version of our network with 384 neurons and 32,768 synapses still maintained an accuracy of about 77%, extending its application to ultra-low-cost situations. Both versions need less than 30,000 samples to reach convergence, which is a >50% reduction compared to other similar networks. As for robustness, it is immune to the fluctuation of MRAM cell resistance.

Low-Hardware-Cost SNN Employing FeFET-based Neurons with Tunable Leaky Effect

Capacitor-less Stochastic Leaky-FeFET Neuron of Both Excitatory and Inhibitory Connections for SNN with Reduced Hardware Cost

Bio-Inspired Neurons Based on Novel Leaky-FeFET with Ultra-Low Hardware Cost and Advanced Functionality for All-Ferroelectric Neural Network

Ultra-Low-Power Compact Neuron Circuit with Tunable Spiking Frequency and High Robustness in 22 Nm FDSOI

A Biomimetic Tunnel FET-Based Spiking Neuron for Energy-Efficient Neuromorphic Computing with Reduced Hardware Cost

55 Nm CMOS Mixed-Signal Neuromorphic Circuits for Constructing Energy-Efficient Reconfigurable SNNs

Compact artificial neuron based on anti-ferroelectric transistor

A Novel Ferroelectric FET-Based Adaptively-Stochastic Neuron for Stimulated-Annealing Based Optimizer with Ultra-Low Hardware Cost

Quantum Tunneling Based Ultra-Compact and Energy Efficient Spiking Neuron Enables Hardware SNN

Low-Cost Adaptive Exponential Integrate-and-Fire Neuron Using Stochastic Computing.

Ferroelectric FET Based Signed Synapses of Excitatory and Inhibitory Connection Fo Stochastic Spiking Neural Network Based Optimizer

Highly efficient neuromorphic learning system of spiking neural network with multi-compartment leaky integrate-and-fire neurons

A Low-Cost Hardware-Friendly Spiking Neural Network Based on Binary MRAM Synapses, Accelerated Using In-Memory Computing

A 4096-Neuron 1M-Synapse 3.8-pJ/SOP Spiking Neural Network With On-Chip STDP Learning and Sparse Weights in 10-nm FinFET CMOS

A Neuromorphic Spiking Neural Network Using Time-to-First-Spike Coding Scheme and Analog Computing in Low-Leakage 8T SRAM

Low-energy and tunable LIF neuron using SiGe bandgap-engineered resistive switching transistor

A Co-Designed Neuromorphic Chip with Compact (17.9K F2) and Weak Neuron Number-Dependent Neuron/Synapse Modules

Spintronic leaky-integrate-fire spiking neurons with self-reset and winner-takes-all for neuromorphic computing

Band-to-Band Tunneling based Ultra-Energy Efficient Silicon Neuron

Leaky integrate-and-fire neurons based on perovskite memristor for spiking neural networks

Efficient Spiking Neural Networks with Biologically Similar Lithium-Ion Memristor Neurons