Abstract:In recent years, the scaling down that Moore’s Law relies on has been gradually slowing down, and the traditional von Neumann architecture has been limiting the improvement of computing power. Thus, neuromorphic in-memory computing hardware has been proposed and is becoming a promising alternative. However, there is still a long way to make it possible, and one of the problems is to provide an efficient, reliable, and achievable neural network for hardware implementation. In this paper, we proposed a two-layer fully connected spiking neural network based on binary MRAM (Magneto-resistive Random Access Memory) synapses with low hardware cost. First, the network used an array of multiple binary MRAM cells to store multi-bit fixed-point weight values. This helps to simplify the read/write circuit. Second, we used different kinds of spike encoders that ensure the sparsity of input spikes, to reduce the complexity of peripheral circuits, such as sense amplifiers. Third, we designed a single-step learning rule, which fit well with the fixed-point binary weights. Fourth, we replaced the traditional exponential Leak-Integrate-Fire (LIF) neuron model to avoid the massive cost of exponential circuits. The simulation results showed that, compared to other similar works, our SNN with 1184 neurons and 313,600 synapses achieved an accuracy of up to 90.6% in the MNIST recognition task with full-resolution (28 × 28) and full-bit-depth (8-bit) images. In the case of low-resolution (16 × 16) and black-white (1-bit) images, the smaller version of our network with 384 neurons and 32,768 synapses still maintained an accuracy of about 77%, extending its application to ultra-low-cost situations. Both versions need less than 30,000 samples to reach convergence, which is a >50% reduction compared to other similar networks. As for robustness, it is immune to the fluctuation of MRAM cell resistance.

First Realization of Batch Normalization in Flash-Based Binary Neural Networks Using a Single Voltage Shifter

L1 -Norm Batch Normalization for Efficient Training of Deep Neural Networks

Shift-BNN: Highly-Efficient Probabilistic Bayesian Neural Network Training via Memory-Friendly Pattern Retrieving

Optimizing data-flow in Binary Neural Networks

Binary Neural Network with 16 Mb Rram Macro Chip for Classification and Online Training

A New Hardware Implementation Approach Of Bnns Based On Nonlinear 2t2r Synaptic Cell

Memory-Efficient Batch Normalization By One-Pass Computation for On-Device Training

Restructuring Batch Normalization to Accelerate CNN Training

Neural Network-Hardware Co-design for Scalable RRAM-based BNN Accelerators

An Improved RRAM-Based Binarized Neural Network with High Variation-Tolerated Forward/Backward Propagation Module

A Low-Cost Hardware-Friendly Spiking Neural Network Based on Binary MRAM Synapses, Accelerated Using In-Memory Computing

Hardware Implementation of Energy Efficient Deep Learning Neural Network Based on Nanoscale Flash Computing Array

Hardware Implementation Of Rram Based Binarized Neural Networks

Memristive KDG-BNN: Memristive binary neural networks trained via knowledge distillation and generative adversarial networks

Binarized Neural Network Comprising Quasi‐Nonvolatile Memory Devices for Neuromorphic Computing

Temporal Effective Batch Normalization in Spiking Neural Networks

Rram-Based Binary Neural Networks Using Back-Propagation Learning

A Novel Neural Network with Digital Synaptic Weights Based on 3D NAND Flash Array

Deep Spiking Convolutional Neural Networks for Programmable Neuro-synaptic System

A Visual Bionic Neural Encoder Based on NPC Memristor for Spiking Neural Network

Analog Deep Neural Network Based On Nor Flash Computing Array For High Speed/Energy Efficiency Computation