Abstract:In recent years, the scaling down that Moore’s Law relies on has been gradually slowing down, and the traditional von Neumann architecture has been limiting the improvement of computing power. Thus, neuromorphic in-memory computing hardware has been proposed and is becoming a promising alternative. However, there is still a long way to make it possible, and one of the problems is to provide an efficient, reliable, and achievable neural network for hardware implementation. In this paper, we proposed a two-layer fully connected spiking neural network based on binary MRAM (Magneto-resistive Random Access Memory) synapses with low hardware cost. First, the network used an array of multiple binary MRAM cells to store multi-bit fixed-point weight values. This helps to simplify the read/write circuit. Second, we used different kinds of spike encoders that ensure the sparsity of input spikes, to reduce the complexity of peripheral circuits, such as sense amplifiers. Third, we designed a single-step learning rule, which fit well with the fixed-point binary weights. Fourth, we replaced the traditional exponential Leak-Integrate-Fire (LIF) neuron model to avoid the massive cost of exponential circuits. The simulation results showed that, compared to other similar works, our SNN with 1184 neurons and 313,600 synapses achieved an accuracy of up to 90.6% in the MNIST recognition task with full-resolution (28 × 28) and full-bit-depth (8-bit) images. In the case of low-resolution (16 × 16) and black-white (1-bit) images, the smaller version of our network with 384 neurons and 32,768 synapses still maintained an accuracy of about 77%, extending its application to ultra-low-cost situations. Both versions need less than 30,000 samples to reach convergence, which is a >50% reduction compared to other similar networks. As for robustness, it is immune to the fluctuation of MRAM cell resistance.

Energy Efficient Spiking Neural Network Design with RRAM Devices

Energy Efficient RRAM Spiking Neural Network for Real Time Classification

Spiking Neural Network with RRAM: Can We Use It for Real-World Application?

Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks

RRAM-Based Spiking Neural Network with Target-Modulated Spike-Timing-Dependent Plasticity

A Memristor-Based Spiking Neural Network With High Scalability and Learning Efficiency

Memristor Based Spiking Neural Network Accelerator Architecture

Towards Energy-Preserving Natural Language Understanding with Spiking Neural Networks

A Digitalized RRAM-based Spiking Neuron Network System with 3-Bit Weight and Unsupervised Online Learning Scheme

30.2 A 22nm 0.26nW/Synapse Spike-Driven Spiking Neural Network Processing Unit Using Time-Step-First Dataflow and Sparsity-Adaptive In-Memory Computing

FangTianSim: High-Level Cycle-Accurate Resistive Random-Access Memory-Based Multi-Core Spiking Neural Network Processor Simulator

A Low-Cost Hardware-Friendly Spiking Neural Network Based on Binary MRAM Synapses, Accelerated Using In-Memory Computing

An Energy Efficient STDP-Based SNN Architecture With On-Chip Learning

STCSNN: High energy efficiency spike-train level spiking neural networks with spatio-temporal conversion

You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy

EnforceSNN: Enabling Resilient and Energy-Efficient Spiking Neural Network Inference considering Approximate DRAMs for Embedded Systems

SNrram: an Efficient Sparse Neural Network Computation Architecture Based on Resistive Random-Access Memory.

An Area- and Energy-Efficient Spiking Neural Network with Spike-Time-Dependent Plasticity Realized with SRAM Processing-in-Memory Macro and On-Chip Unsupervised Learning.

A Spike Neuron Network Prototype Based on RRAM Array

PT-Spike: A Precise-Time-Dependent Single Spike Neuromorphic Architecture with Efficient Supervised Learning

RRAM-based Analog-Weight Spiking Neural Network Accelerator with In-Situ Learning for IoT Applications