Abstract:The emerging resistive random-access memory (RRAM) has been widely applied in accelerating the computing of deep neural networks. However, it is challenging to achieve high-precision computations based on RRAM due to the limits of the resistance level and the interfaces. Low bit-width convolutional neural networks (CNNs) provide promising solutions to introduce low bit-width RRAM devices and low bit-width interfaces in RRAM-based computing system (RCS). While open questions still remain regarding: 1) how to make matrix splitting when a single crossbar is not large enough to hold all parameters of one weight matrix; 2) how to design a pipeline to accelerate the inference based on line buffer structure; and 3) how to reduce the accuracy drop due to the parameter splitting and data quantization. In this paper, we propose an RRAM crossbar-based low bit-width CNN (LB-CNN) accelerator. We make detailed discussion on the system design, including the matrix splitting strategies to enhance the scalability, and the pipelined implementation based on line buffers to accelerate the inference. In addition, we propose a splitting and quantizing while training method to incorporate the actual hardware constraints with the training. In our experiments, low bit-width LeNet-5 on RRAM show much better robustness than multibit models with device variation. The pipeline strategy achieves approximately 6.0x speedup to process each image on ResNet-18. For low-bit VGG-8 on CIFAR-10, the proposed accelerator saves 54.9% of the energy consumption and 48.3% of the area compared with the multibit VGG-8 structure.

Neural Network-Inspired Analog-to-Digital Conversion to Achieve Super-Resolution with Low-Precision RRAM Devices

Evaluating Neural Network-Inspired Analog-to-Digital Conversion with Low-Precision RRAM

Low Bit-Width Convolutional Neural Network on RRAM

High-Throughput In-Memory Computing for Binary Deep Neural Networks with Monolithically Integrated RRAM and 90nm CMOS

Device and circuit optimization of RRAM for neuromorphic computing

Convolutional Neural Networks Based on RRAM Devices for Image Recognition and Online Learning Tasks

A Configurable Multi-Precision CNN Computing Framework Based on Single Bit RRAM

Enabling RRAM-Based Brain-Inspired Computation by Co-design of Device, Circuit, and System

Training Low Bitwidth Convolutional Neural Network on RRAM

Spiking Neural Network with RRAM: Can We Use It for Real-World Application?

An ADC-less RRAM-based Computing-in-Memory Macro with Binary CNN for Efficient Edge AI

RRAM-DNN: an RRAM and Model-Compression Empowered All-Weights-On-Chip DNN Accelerator

Neural Network-Hardware Co-design for Scalable RRAM-based BNN Accelerators

A 28-Nm RRAM Computing-in-Memory Macro Using Weighted Hybrid 2T1R Cell Array and Reference Subtracting Sense Amplifier for AI Edge Inference

Sign backpropagation: An on-chip learning algorithm for analog RRAM neuromorphic computing systems

Straightforward Data Transfer in a Blockwise Dataflow for an Analog RRAM-based CIM System

Switched by input: power efficient structure for RRAM-based convolutional neural network.

Binary Neural Network with 16 Mb Rram Macro Chip for Classification and Online Training

Bayesian Neural Network Realization by Exploiting Inherent Stochastic Characteristics of Analog RRAM

Hardware Implementation Of Rram Based Binarized Neural Networks

Binary Convolutional Neural Network on RRAM.