Abstract:Resistive random access memory (ReRAM)-based processing-in-memory (PIM) architectures have demonstrated great potential to accelerate Deep Neural Network (DNN) training/inference. However, the computational accuracy of analog PIM is compromised due to the non-idealities, such as the conductance variation of ReRAM cells. The impact of these non-idealities worsens as the number of concurrently activated wordlines and bitlines increases. To guarantee computational accuracy, only a limited number of wordlines and bitlines of the crossbar array can be turned on concurrently, significantly reducing the achievable parallelism of the architecture. While the constraints on parallelism limit the efficiency of the accelerators, they also provide a new opportunity for fine-grained mixed-precision quantization. To enable efficient DNN inference on practical ReRAM-based accelerators, we propose an algorithm-architecture co-design framework called \underline{B}lock-\underline{W}ise mixed-precision \underline{Q}uantization (BWQ). At the algorithm level, BWQ-A introduces a mixed-precision quantization scheme at the block level, which achieves a high weight and activation compression ratio with negligible accuracy degradation. We also present the hardware architecture design BWQ-H, which leverages the low-bit-width models achieved by BWQ-A to perform high-efficiency DNN inference on ReRAM devices. BWQ-H also adopts a novel precision-aware weight mapping method to increase the ReRAM crossbar's throughput. Our evaluation demonstrates the effectiveness of BWQ, which achieves a 6.08x speedup and a 17.47x energy saving on average compared to existing ReRAM-based architectures.

Design Guidelines of RRAM Based Neural-Processing-Unit

System and Technology Co-optimization for RRAM Based Computation-in-memory Chip

Device and circuit optimization of RRAM for neuromorphic computing

Enabling RRAM-Based Brain-Inspired Computation by Co-design of Device, Circuit, and System

A Circuit-Algorithm Codesign Method to Reduce the Accuracy Drop of RRAM Based Computing-in-memory Chip

Cross-layer Designs against Non-ideal Effects in ReRAM-based Processing-in-Memory System

Evaluating Neural Network-Inspired Analog-to-Digital Conversion with Low-Precision RRAM

Intelligent Computing with RRAM

A Compact Model of Analog RRAM With Device and Array Nonideal Effects for Neuromorphic Systems

Intra-array Non-Idealities Modeling and Algorithm Optimization for RRAM-based Computing-in-Memory Applications

Multiscale Co-Design Analysis of Energy, Latency, Area, and Accuracy of a ReRAM Analog Neural Training Accelerator

Neuromorphic Computing Based on Resistive RAM.

RRAM-based Coprocessors for Deep Learning

Design guidelines for 3D RRAM cross-point architecture

Block-Wise Mixed-Precision Quantization: Enabling High Efficiency for Practical ReRAM-based DNN Accelerators

HARNS: High-level Architectural Model of RRAM Based Computing-in-memory NPU

FangTianSim: High-Level Cycle-Accurate Resistive Random-Access Memory-Based Multi-Core Spiking Neural Network Processor Simulator

Sign backpropagation: An on-chip learning algorithm for analog RRAM neuromorphic computing systems

Hardware Implementation Of Rram Based Binarized Neural Networks

Neural Network-Inspired Analog-to-Digital Conversion to Achieve Super-Resolution with Low-Precision RRAM Devices

A Compact Model of Analog RRAM for Neuromorphic Computing System Design