Abstract:ReRAM-based computing is good at accelerating convolutional neural network (CNN) inference due to its high computing parallelism, but its rigid crossbar structure may become less efficient in the face of the random data sparsity abundant in CNNs. In this study, we propose $3A$ -ReRAM, a novel crossbar architecture that can dynamically predict the accumulated results to enable adaptive activation accumulation, so that both zero and small values in feature map can be exploited in each matrix-vector multiplication (MVM) operation for speedup. To dynamically predict the results, we propose an efficient parallel predictor to find larger adapted boxes for increased computing parallelism without hurting accuracy. For a better scheduling between the dynamic predictions, we propose an efficient input window management with light-weight hardware support. With dynamic prediction and calculation, $3A$ -ReRAM architecture naturally fits the ReRAM crossbar structure but enables a totally different way to dynamically exploit the sparsity and small values in feature maps. It greatly improves the performance by increasing the computing parallelism and saves energy consumption by much less analog-digital conversions. The evaluation results show that $3A$ -ReRAM architecture can increase the performance by up to $13.03\times $ , $16.31\times $ , $2.46\times $ , and $2.58\times $ compared to ReRAM-based CNN accelerators ISAAC, PUMA (sparsity-unaware) and SRE, FORMS (sparsity-aware), and the total energy can be reduced by $8.93\times $ , $10.07\times $ , $2.97\times $ , and $4.58\times $ , respectively.

Frequency-Domain Inference Acceleration for Convolutional Neural Networks Using ReRAMs

An Efficient Reram-Based Inference Accelerator For Convolutional Neural Networks Via Activation Reuse

Efficient Implementation of Multi-Channel Convolution in Monolithic 3D ReRAM Crossbar

3A-Reram: Adaptive Activation Accumulation in ReRAM-Based CNN Accelerator

An Energy-Efficient Mixed-Bit ReRAM-based Computing-in-Memory CNN Accelerator with Fully Parallel Readout.

A 1T2R1C ReRAM CIM Accelerator with Energy-Efficient Voltage Division and Capacitive Coupling for CNN Acceleration in AI Edge Applications.

An Energy-Efficient Mixed-Bit CNN Accelerator With Column Parallel Readout for ReRAM-Based In-Memory Computing

A ReRAM-Based Row-Column-Oriented Memory Architecture for Convolutional Neural Networks.

A Low-Latency DNN Accelerator Enabled by DFT-Based Convolution Execution Within Crossbar Arrays

Ultra-High-Speed Accelerator Architecture for Convolutional Neural Network Based on Processing-in-Memory Using Resistive Random Access Memory

CompRRAE: RRAM-based Convolutional Neural Network Accelerator with Reduced Computations through a Runtime Activation Estimation

A High-Throughput and Energy-Efficient RRAM-based Convolutional Neural Network Using Data Encoding and Dynamic Quantization.

XB-SIM∗: A Simulation Framework for Modeling and Exploration of ReRAM-based CNN Acceleration Design

A Systolic Computing-in-Memory Array Based Accelerator with Predictive Early Activation for Spatiotemporal Convolutions

Design of a Convolutional Neural Network Accelerator Based on On-Chip Data Reordering

A 3d Multi-Layer Cmos-Rram Accelerator for Neural Network

RRAM Based Buffer Design for Energy Efficient CNN Accelerator.

ReHy: A ReRAM-based Digital/Analog Hybrid PIM Architecture for Accelerating CNN Training

A Configurable Multi-Precision CNN Computing Framework Based on Single Bit RRAM

CAP-RAM: A Charge-Domain In-Memory Computing 6T-SRAM for Accurate and Precision-Programmable CNN Inference

Accelerating Low Bit-Width Deep Convolution Neural Network in MRAM.