Abstract:Although the CMOS-based CNN accelerators have achieved impressive progress, the memory wall issue and the high power density are still the major barriers for substantial improvement in energy efficiency and throughput. As an attractive alternative, recently the Resistive RAM-based accelerators have delivered significant breakthroughs by leveraging the in-situ computation. However, there are still some challenges, including the high computation complexity and the large energy overhead at the analog/digital interfacing circuits. In this work, we take advantage of the subword-based computation in the Resistive RAM-based accelerator to achieve energy saving and speedup. First, an encoding method is proposed for the weights and activations to reduce the energy consumption of the in-situ computation and the resolution requirement of ADC. Then the resolution of ADC is further optimized based on the distribution of the subword computation results. Furthermore, a dynamic quantization scheme is proposed to skip 67%–87% of the subword computations which outperforms the conventional quantization schemes. We fully investigate the influences of the encoding scheme and the layer-wise quantization range scaling on the performance of dynamic quantization. Finally, we demonstrate the effectiveness of the proposed algorithms under different hardware configurations and network complexities. A dedicated architecture, SubMac, is proposed to implement the above schemes. Experimental results show that the energy efficiency and the throughput are improved by 2.8–5.7 and 2.5–7.9 times, respectively, when compared with the state-of-the-art Resistive RAM-based accelerators.

Mixed Size Crossbar Based RRAM CNN Accelerator with Overlapped Mapping Method

High Area/Energy Efficiency RRAM CNN Accelerator with Pattern-Pruning-Based Weight Mapping Scheme

CompRRAE: RRAM-based Convolutional Neural Network Accelerator with Reduced Computations through a Runtime Activation Estimation

An Energy-Efficient Mixed-Bit ReRAM-based Computing-in-Memory CNN Accelerator with Fully Parallel Readout.

RISC-V based Fully-Parallel SRAM Computing-in-Memory Accelerator with High Hardware Utilization and Data Reuse Rate

RRAM Based Buffer Design for Energy Efficient CNN Accelerator.

An Energy-Efficient Mixed-Bit CNN Accelerator With Column Parallel Readout for ReRAM-Based In-Memory Computing

A Configurable Multi-Precision CNN Computing Framework Based on Single Bit RRAM

3A-Reram: Adaptive Activation Accumulation in ReRAM-Based CNN Accelerator

AEPE: an Area and Power Efficient RRAM Crossbar-Based Accelerator for Deep CNNs

A Universal RRAM-Based DNN Accelerator with Programmable Crossbars Beyond MVM Operator

An Efficient Reram-Based Inference Accelerator For Convolutional Neural Networks Via Activation Reuse

Switched by input: power efficient structure for RRAM-based convolutional neural network.

SubMac: Exploiting the Subword-Based Computation in RRAM-based CNN Accelerator for Energy Saving and Speedup

Low Bit-Width Convolutional Neural Network on RRAM

Efficient Implementation of Multi-Channel Convolution in Monolithic 3D ReRAM Crossbar

Technological Exploration of Rram Crossbar Array for Matrix-Vector Multiplication

NAND-SPIN-based processing-in-MRAM architecture for convolutional neural network acceleration

XB-SIM∗: A Simulation Framework for Modeling and Exploration of ReRAM-based CNN Acceleration Design

A 3d Multi-Layer Cmos-Rram Accelerator for Neural Network

APIM: An Antiferromagnetic MRAM-Based Processing-In-Memory System for Efficient Bit-level Operations of Quantized Convolutional Neural Networks