Abstract:The training of neural network (NN) is usually time-consuming and resource intensive. Memristor has shown its potential in computation of NN. Especially for the metal-oxide resistive random access memory (RRAM), its crossbar structure and multi-bit characteristic can perform the matrix-vector product in high precision, which is the most common operation of NN. However, there exist two challenges on realizing the training of NN. Firstly, the current architecture can only support the inference phase of training and cannot perform the backpropagation (BP), the weights update of NN. Secondly, the training of NN requires enormous iterations and constantly updates the weights to reach the convergence, which leads to large energy consumption because of lots of write and read operations. In this work, we propose a novel architecture, TIME, and peripheral circuit designs to enable the training of NN in RRAM. TIME supports the BP and the weights update while maximizing the reuse of peripheral circuits for the inference operation on RRAM. Meanwhile, a variability-free tuning scheme and gradually-write circuits are designed to reduce the cost of tuning RRAM. We explore the performance of both SL (supervised learning) and DRL ( deep reinforcement learning) in TIME, and a specific mapping method of DRL is also introduced to further improve the energy efficiency. Experimental results show that, in SL, TIME can achieve 5.3x higher energy efficiency on average compared with the most powerful application-specific integrated circuits (ASIC) in the literature. In DRL, TIME can perform averagely 126x higher than GPU in energy efficiency. If the cost of tuning RRAM can be further reduced, TIME have the potential of boosting the energy efficiency by 2 orders of magnitude compared with ASIC.

Fast and Accurate Weight Updating Strategy for Resistive Random-Access Memory (Rram)-Based Neural Networks

Hardware Implementation Of Rram Based Binarized Neural Networks

Optimized Programming Scheme Enabling Symmetric Conductance Modulation in HfO₂ Resistive Random-Access Memory (RRAM) for Neuromorphic Systems

Weighted Synapses Without Carry Operations for RRAM-Based Neuromorphic Systems

Improvement of State Stability in Multi-Level Resistive Random-Access Memory (RRAM) Array for Neuromorphic Computing

Accurate Program/Verify Schemes of Resistive Switching Memory (RRAM) for In-Memory Neural Network Circuits

Circuit Modeling for RRAM-Based Neuromorphic Chip Crossbar Array with and Without Write-Verify Scheme.

Optimization Strategy for Accelerating Multi-Bit Resistive Weight Programming on the RRAM Array

SNrram: an Efficient Sparse Neural Network Computation Architecture Based on Resistive Random-Access Memory.

EFFICIENT WEIGHT MAPPING SCHEME WITHOUT VERIFICATION FOR RRAM BASED NEUROMORPHIC COMPUTING

A High-Speed and High-Efficiency Diverse Error Margin Write-Verify Scheme for an RRAM-Based Neuromorphic Hardware Accelerator

TIME: A Training-in-Memory Architecture for RRAM-Based Deep Neural Networks

A Parallel Multibit Programing Scheme with High Precision for RRAM-Based Neuromorphic Systems

An RRAM Retention Prediction Framework Using a Convolutional Neural Network Based on Relaxation Behavior

Bit-Aware Fault-Tolerant Hybrid Retraining and Remapping Schemes for RRAM-Based Computing-in-Memory Systems

Characterizing Endurance Degradation of Incremental Switching in Analog RRAM for Neuromorphic Systems

A Compact Model of Analog RRAM With Device and Array Nonideal Effects for Neuromorphic Systems

Convolutional Neural Networks Based on RRAM Devices for Image Recognition and Online Learning Tasks

Device and circuit optimization of RRAM for neuromorphic computing

Spiking Neural Network with RRAM: Can We Use It for Real-World Application?

An Improved RRAM-Based Binarized Neural Network with High Variation-Tolerated Forward/Backward Propagation Module