Abstract:Recently it has been demonstrated that binary neural network (BNNs) can achieve satisfying accuracy on various databases with the significant reduction of computation and memory resources [1], which provides a promising way for on-chip implementation of deep neural networks (DNNs). To storage synaptic weights, the SRAM is traditionally utilized in the CMOS based ASIC designs for hardware acceleration implementation of DNNs. However, it has been proved to be extremely area- and power-inefficiency due to its large cell area ( >200 F 2 ) and volatility, respectively. To overcome these issues, the emerging non-volatile spin transfer torque magnetoresistive RAM (STT-MRAM) with small cell area (<; 10 F 2 ) recently has been proposed to implement synaptic weights instead of SRAM [2]. Moreover, STT-MRAM has been demonstrated at Gb chip-level by industry [3]. In this paper, a single-layer binary perceptron (BP) is proposed for image recognition, which can be implemented via the pseudo-crossbar array of 1T-1MTJ (STT-MRAM cell) as shown in Fig. 1(a). With the learning rule in [1], such BP was trained in an off-line manner on a set of N = 30 patterns, including three stylized letters (`z', `v', `n') as shown in Fig. 1(b) [4], which also was used for testing. To classify these three stylized letters, we design a winner-takes-all (WTA) circuit as shown in Fig. 1(c), which is used as the peripheral inference circuit of proposed BP. Based on a physics-based STT-MTJ compact model and a commercial CMOS 40 nm design kit, the functionality of the proposed BP and WTA circuit have been demonstrated as shown in Fig. 2(a). Additionally, we also investigate the impact of TMR and device variations on the recognition rate as shown in Fig. 2(b)and Fig. 2(c), respectively. In summary, a STT-MRAM based binary synaptic array with a WTA circuit has been proposed for image recognition, which provides a promising solution for hardware implementation of BNNs on-chip.

A New Hardware Implementation Approach Of Bnns Based On Nonlinear 2t2r Synaptic Cell

Hardware Implementation Of Rram Based Binarized Neural Networks

An Improved RRAM-Based Binarized Neural Network with High Variation-Tolerated Forward/Backward Propagation Module

Rram-Based Binary Neural Networks Using Back-Propagation Learning

Binary Neural Network with 16 Mb Rram Macro Chip for Classification and Online Training

Parallelizing SRAM Arrays with Customized Bit-Cell for Binary Neural Networks

Binarized Neural Network Comprising Quasi‐Nonvolatile Memory Devices for Neuromorphic Computing

A Digitalized RRAM-based Spiking Neuron Network System with 3-Bit Weight and Unsupervised Online Learning Scheme

Circuit-level Design and Evaluation of STT-MRAM Based Binary Winner-Takes-All Network for Image Recognition

An Improved Hardware Accelaration Architecture of Binary Neural Network With 1T1R Array Based Forward/Backward Propagation Module

A Hardware Neural Network for Handwritten Digits Recognition Using Binary RRAM As Synaptic Weight Element

Go Unary: A Novel Synapse Coding And Mapping Scheme For Reliable Reram-Based Neuromorphic Computing

Batch Normalization-Free Weight-Binarized SNN Based on Hardware-Saving IF Neuron.

STBNN: Hardware-friendly Spatio-Temporal Binary Neural Network with High Pattern Recognition Accuracy

Binary Convolutional Neural Network on RRAM.

Enhanced Linearity in CBRAM Synapse by Post Oxide Deposition Annealing for Neuromorphic Computing Applications

Binary Resistive-Switching-Device-Based Electronic Synapse with Spike-Rate-Dependent Plasticity for Online Learning

A Low-Cost Hardware-Friendly Spiking Neural Network Based on Binary MRAM Synapses, Accelerated Using In-Memory Computing

Weighted Synapses Without Carry Operations for RRAM-Based Neuromorphic Systems

A Novel Neuromorphic Hardware Using Area-Efficient Chain RRAM-Based Synapses and Compact Neurons with (Anti-) Integration Scheme

Deep Spiking Convolutional Neural Networks for Programmable Neuro-synaptic System