Abstract:The training of neural network (NN) is usually time-consuming and resource intensive. Memristor has shown its potential in computation of NN. Especially for the metal-oxide resistive random access memory (RRAM), its crossbar structure and multi-bit characteristic can perform the matrix-vector product in high precision, which is the most common operation of NN. However, there exist two challenges on realizing the training of NN. Firstly, the current architecture can only support the inference phase of training and cannot perform the backpropagation (BP), the weights update of NN. Secondly, the training of NN requires enormous iterations and constantly updates the weights to reach the convergence, which leads to large energy consumption because of lots of write and read operations. In this work, we propose a novel architecture, TIME, and peripheral circuit designs to enable the training of NN in RRAM. TIME supports the BP and the weights update while maximizing the reuse of peripheral circuits for the inference operation on RRAM. Meanwhile, a variability-free tuning scheme and gradually-write circuits are designed to reduce the cost of tuning RRAM. We explore the performance of both SL (supervised learning) and DRL ( deep reinforcement learning) in TIME, and a specific mapping method of DRL is also introduced to further improve the energy efficiency. Experimental results show that, in SL, TIME can achieve 5.3x higher energy efficiency on average compared with the most powerful application-specific integrated circuits (ASIC) in the literature. In DRL, TIME can perform averagely 126x higher than GPU in energy efficiency. If the cost of tuning RRAM can be further reduced, TIME have the potential of boosting the energy efficiency by 2 orders of magnitude compared with ASIC.

Analog CMOS-based Resistive Processing Unit for Deep Neural Network Training

Acceleration of Deep Neural Network Training with Resistive Cross-Point Devices

Training Deep Convolutional Neural Networks with Resistive Cross-Point Devices

Training LSTM Networks with Resistive Cross-Point Devices

Multiscale Co-Design Analysis of Energy, Latency, Area, and Accuracy of a ReRAM Analog Neural Training Accelerator

A 3.89-Gops/mw Scalable Recurrent Neural Network Processor with Improved Efficiency on Memory and Computation

Design Guidelines of RRAM Based Neural-Processing-Unit

RRAM-based Coprocessors for Deep Learning

Resistive Neural Hardware Accelerators

Sign backpropagation: An on-chip learning algorithm for analog RRAM neuromorphic computing systems

PL-NPU: an Energy-Efficient Edge-Device DNN Training Processor with Posit-Based Logarithm-Domain Computing

Neuromorphic Computing Based on Resistive RAM.

RRAM-DNN: an RRAM and Model-Compression Empowered All-Weights-On-Chip DNN Accelerator

NEON: Enabling Efficient Support for Nonlinear Operations in Resistive RAM-based Neural Network Accelerators

A flexible and fast digital twin for RRAM systems applied for training resilient neural networks

Accelerating Neural Network Inference with Processing-in-DRAM: From the Edge to the Cloud

TIME: A Training-in-Memory Architecture for RRAM-Based Deep Neural Networks

A Low-Latency DNN Accelerator Enabled by DFT-Based Convolution Execution Within Crossbar Arrays

A 3d Multi-Layer Cmos-Rram Accelerator for Neural Network

Nonvolatile Memory Materials for Neuromorphic Intelligent Machines

RCPE: an Excellent Performance Training Processor with RISC-V Based Compression Mechanism