Abstract:The training of neural network (NN) is usually time-consuming and resource intensive. Memristor has shown its potential in computation of NN. Especially for the metal-oxide resistive random access memory (RRAM), its crossbar structure and multi-bit characteristic can perform the matrix-vector product in high precision, which is the most common operation of NN. However, there exist two challenges on realizing the training of NN. Firstly, the current architecture can only support the inference phase of training and cannot perform the backpropagation (BP), the weights update of NN. Secondly, the training of NN requires enormous iterations and constantly updates the weights to reach the convergence, which leads to large energy consumption because of lots of write and read operations. In this work, we propose a novel architecture, TIME, and peripheral circuit designs to enable the training of NN in RRAM. TIME supports the BP and the weights update while maximizing the reuse of peripheral circuits for the inference operation on RRAM. Meanwhile, a variability-free tuning scheme and gradually-write circuits are designed to reduce the cost of tuning RRAM. We explore the performance of both SL (supervised learning) and DRL ( deep reinforcement learning) in TIME, and a specific mapping method of DRL is also introduced to further improve the energy efficiency. Experimental results show that, in SL, TIME can achieve 5.3x higher energy efficiency on average compared with the most powerful application-specific integrated circuits (ASIC) in the literature. In DRL, TIME can perform averagely 126x higher than GPU in energy efficiency. If the cost of tuning RRAM can be further reduced, TIME have the potential of boosting the energy efficiency by 2 orders of magnitude compared with ASIC.

Artificial Neural Networks Based on Intelligent Memory

DaDianNao: A Machine-Learning Supercomputer

A neuron-weighted learning algorithm and its hardware implementation in associative memories

Neural Architecture Search with In‐Memory Multiply–Accumulate and In‐Memory Rank Based on Coating Layer Optimized C‐Doped Ge2Sb2Te5 Phase Change Memory

Memristor-based Neuromorphic Implementations for Artificial Neural Networks

In-Memory Computing Integrated Structure Circuit Based on Nonvolatile Flash Memory Unit

An Energy-Efficient Architecture for Accelerating Inference of Memory-Augmented Neural Networks

Flash Memory Array for Efficient Implementation of Deep Neural Networks

Highly Efficient Neuromorphic Computing Systems with Emerging Nonvolatile Memories

TIME: A Training-in-Memory Architecture for RRAM-Based Deep Neural Networks

Neural Networks on Chip: from CMOS Accelerators to In-Memory-Computing

A Compact and Configurable Long Short-Term Memory Neural Network Hardware Architecture.

SIMSnn: A Weight-Agnostic ReRAM-based Search-In-Memory Engine for SNN Acceleration.

Optimized operation scheme of flash-memory-based neural network online training with ultra-high endurance

Learning Memory Access Patterns

Hardware Efficient Reconfigurable Logic-in-Memory Circuit Based Neural Network Computing.

A Low-Power RRAM Memory Block for Embedded, Multi-Level Weight and Bias Storage in Artificial Neural Networks

An Ultra-Efficient Memristor-Based DNN Framework with Structured Weight Pruning and Quantization Using ADMM

Spatial-Temporal Hybrid Neural Network With Computing-in-Memory Architecture

Semantic memory-based dynamic neural network using memristive ternary CIM and CAM for 2D and 3D vision

A Full-Neuron Memory Model Designed for Neuromorphic Systems