Abstract:In recent years, the scaling down that Moore’s Law relies on has been gradually slowing down, and the traditional von Neumann architecture has been limiting the improvement of computing power. Thus, neuromorphic in-memory computing hardware has been proposed and is becoming a promising alternative. However, there is still a long way to make it possible, and one of the problems is to provide an efficient, reliable, and achievable neural network for hardware implementation. In this paper, we proposed a two-layer fully connected spiking neural network based on binary MRAM (Magneto-resistive Random Access Memory) synapses with low hardware cost. First, the network used an array of multiple binary MRAM cells to store multi-bit fixed-point weight values. This helps to simplify the read/write circuit. Second, we used different kinds of spike encoders that ensure the sparsity of input spikes, to reduce the complexity of peripheral circuits, such as sense amplifiers. Third, we designed a single-step learning rule, which fit well with the fixed-point binary weights. Fourth, we replaced the traditional exponential Leak-Integrate-Fire (LIF) neuron model to avoid the massive cost of exponential circuits. The simulation results showed that, compared to other similar works, our SNN with 1184 neurons and 313,600 synapses achieved an accuracy of up to 90.6% in the MNIST recognition task with full-resolution (28 × 28) and full-bit-depth (8-bit) images. In the case of low-resolution (16 × 16) and black-white (1-bit) images, the smaller version of our network with 384 neurons and 32,768 synapses still maintained an accuracy of about 77%, extending its application to ultra-low-cost situations. Both versions need less than 30,000 samples to reach convergence, which is a >50% reduction compared to other similar networks. As for robustness, it is immune to the fluctuation of MRAM cell resistance.

Adaptive Sparse Coding Based on Memristive Neural Network with Applications

Sparse coding with memristor networks

Memristive neural network circuit design based on locally competitive algorithm for sparse coding application

Single Image Super-Resolution Via the Implementation of the Hardware-Friendly Sparse Coding

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

Forward Stagewise Regression with Multilevel Memristor for Sparse Coding

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

A Memristive Multilayer Cellular Neural Network with Applications to Image Processing

Neuromorphic Extreme Learning Machines with Bimodal Memristive Synapses

Fast and Accurate Sparse Coding of Visual Stimuli With a Simple, Ultralow-Energy Spiking Architecture

Memristor-Based Design of Sparse Compact Convolutional Neural Network

Memristors: Associative Learning with Temporal Contiguity in a Memristive Circuit for Large‐Scale Neuromorphic Networks (Adv. Electron. Mater. 8/2015)

In-situ Learning in Hardware Compatible Multi-layer Memristive Spiking Neural Network

A Novel Memristive Multiscroll Multistable Neural Network with Application to Secure Medical Image Communication

In-situ learning in multilayer locally-connected memristive spiking neural network

A Low-Cost Hardware-Friendly Spiking Neural Network Based on Binary MRAM Synapses, Accelerated Using In-Memory Computing

A Memristive Spiking Neural Network Circuit with Selective Supervised Attention Algorithm

Associative Learning with Temporal Contiguity in a Memristive Circuit for Large‐Scale Neuromorphic Networks

Memristor-Based Neuromorphic System With Content Addressable Memory Structure

Sparse Realization in Unreliable Spin-Transfer-Torque RAM for Convolutional Neural Network

Memristor Based Spiking Neural Network Accelerator Architecture