Abstract:The training of neural network (NN) is usually time-consuming and resource intensive. Memristor has shown its potential in computation of NN. Especially for the metal-oxide resistive random access memory (RRAM), its crossbar structure and multi-bit characteristic can perform the matrix-vector product in high precision, which is the most common operation of NN. However, there exist two challenges on realizing the training of NN. Firstly, the current architecture can only support the inference phase of training and cannot perform the backpropagation (BP), the weights update of NN. Secondly, the training of NN requires enormous iterations and constantly updates the weights to reach the convergence, which leads to large energy consumption because of lots of write and read operations. In this work, we propose a novel architecture, TIME, and peripheral circuit designs to enable the training of NN in RRAM. TIME supports the BP and the weights update while maximizing the reuse of peripheral circuits for the inference operation on RRAM. Meanwhile, a variability-free tuning scheme and gradually-write circuits are designed to reduce the cost of tuning RRAM. We explore the performance of both SL (supervised learning) and DRL ( deep reinforcement learning) in TIME, and a specific mapping method of DRL is also introduced to further improve the energy efficiency. Experimental results show that, in SL, TIME can achieve 5.3x higher energy efficiency on average compared with the most powerful application-specific integrated circuits (ASIC) in the literature. In DRL, TIME can perform averagely 126x higher than GPU in energy efficiency. If the cost of tuning RRAM can be further reduced, TIME have the potential of boosting the energy efficiency by 2 orders of magnitude compared with ASIC.

Sign backpropagation: An on-chip learning algorithm for analog RRAM neuromorphic computing systems

Circuit Modeling for RRAM-Based Neuromorphic Chip Crossbar Array with and Without Write-Verify Scheme.

Device and circuit optimization of RRAM for neuromorphic computing

Hardware Implementation Of Rram Based Binarized Neural Networks

Weighted Synapses Without Carry Operations for RRAM-Based Neuromorphic Systems

Energy Efficient RRAM Spiking Neural Network for Real Time Classification

Neuromorphic Computing Based on Resistive RAM.

A Digitalized RRAM-based Spiking Neuron Network System with 3-Bit Weight and Unsupervised Online Learning Scheme

Training Low Bitwidth Convolutional Neural Network on RRAM

A Compact Model of Analog RRAM for Neuromorphic Computing System Design

Binary Neural Network with 16 Mb Rram Macro Chip for Classification and Online Training

Circuit Design of RRAM-based Neuromorphic Hardware Systems for Classification and Modified Hebbian Learning

An Improved RRAM-Based Binarized Neural Network with High Variation-Tolerated Forward/Backward Propagation Module

RRAM-based Analog-Weight Spiking Neural Network Accelerator with In-Situ Learning for IoT Applications

Optimized Programming Scheme Enabling Symmetric Conductance Modulation in HfO₂ Resistive Random-Access Memory (RRAM) for Neuromorphic Systems

A Compact Model of Analog RRAM With Device and Array Nonideal Effects for Neuromorphic Systems

Optimized learning scheme for grayscale image recognition in a RRAM based analog neuromorphic system

TIME: A Training-in-Memory Architecture for RRAM-Based Deep Neural Networks

A Novel Neuromorphic Hardware Using Area-Efficient Chain RRAM-Based Synapses and Compact Neurons with (Anti-) Integration Scheme

Spiking Neural Network with RRAM: Can We Use It for Real-World Application?

High-Throughput In-Memory Computing for Binary Deep Neural Networks with Monolithically Integrated RRAM and 90nm CMOS