Abstract:In recent years, the scaling down that Moore’s Law relies on has been gradually slowing down, and the traditional von Neumann architecture has been limiting the improvement of computing power. Thus, neuromorphic in-memory computing hardware has been proposed and is becoming a promising alternative. However, there is still a long way to make it possible, and one of the problems is to provide an efficient, reliable, and achievable neural network for hardware implementation. In this paper, we proposed a two-layer fully connected spiking neural network based on binary MRAM (Magneto-resistive Random Access Memory) synapses with low hardware cost. First, the network used an array of multiple binary MRAM cells to store multi-bit fixed-point weight values. This helps to simplify the read/write circuit. Second, we used different kinds of spike encoders that ensure the sparsity of input spikes, to reduce the complexity of peripheral circuits, such as sense amplifiers. Third, we designed a single-step learning rule, which fit well with the fixed-point binary weights. Fourth, we replaced the traditional exponential Leak-Integrate-Fire (LIF) neuron model to avoid the massive cost of exponential circuits. The simulation results showed that, compared to other similar works, our SNN with 1184 neurons and 313,600 synapses achieved an accuracy of up to 90.6% in the MNIST recognition task with full-resolution (28 × 28) and full-bit-depth (8-bit) images. In the case of low-resolution (16 × 16) and black-white (1-bit) images, the smaller version of our network with 384 neurons and 32,768 synapses still maintained an accuracy of about 77%, extending its application to ultra-low-cost situations. Both versions need less than 30,000 samples to reach convergence, which is a >50% reduction compared to other similar networks. As for robustness, it is immune to the fluctuation of MRAM cell resistance.

Binary Resistive-Switching-Device-Based Electronic Synapse with Spike-Rate-Dependent Plasticity for Online Learning

Hardware Demonstration of SRDP Neuromorphic Computing with Online Unsupervised Learning Based on Memristor Synapses

A Digitalized RRAM-based Spiking Neuron Network System with 3-Bit Weight and Unsupervised Online Learning Scheme

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

Stochastic dendrites enable online learning in mixed-signal neuromorphic processing systems

A Spike Neuron Network Prototype Based on RRAM Array

Stochastic Artificial Synapses Based on Nanoscale Magnetic Tunnel Junction for Neuromorphic Applications

Dendritic-Inspired Processing Enables Bio-Plausible STDP in Compound Binary Synapses

Improving energy efficiency and classification accuracy of neuromorphic chips by learning binary synaptic crossbars

A Neuromorphic-Hardware Oriented Bio-Plausible Online-Learning Spiking Neural Network Model.

Stochastic Learning in Oxide Binary Synaptic Device for Neuromorphic Computing.

Memristive neural network for on-line learning and tracking with brain-inspired spike timing dependent plasticity

Efficient Spike-Driven Learning With Dendritic Event-Based Processing

A Low-Cost Hardware-Friendly Spiking Neural Network Based on Binary MRAM Synapses, Accelerated Using In-Memory Computing

In-situ Learning in Hardware Compatible Multi-layer Memristive Spiking Neural Network

A Memristor-Based Spiking Neural Network With High Scalability and Learning Efficiency

Ultra-low-energy Three-Dimensional Oxide-Based Electronic Synapses for Implementation of Robust High-Accuracy Neuromorphic Computation Systems.

Stochastic spin-orbit-torque device as the STDP synapse for spiking neural networks

Homogeneous Spiking Neuromorphic System for Real-World Pattern Recognition

A Spike-Event-Based Neuromorphic Processor with Enhanced On-Chip STDP Learning in 28nm CMOS