Abstract:Processing Using Memory (PUM) accelerators have the potential to perform Deep Neural Network (DNN) inference by using arrays of memory cells as computation engines. Among various memory technologies, ReRAM crossbars show promising performance in computing dot-product operations in the analog domain. Nevertheless, the expensive writing procedure of ReRAM cells has led researchers to design accelerators whose crossbars have enough capacity to store the full DNN. Given the tremendous and continuous increase in DNN model sizes, this approach is unfeasible for some networks, or inefficient due to the huge hardware requirements. Those accelerators lack the flexibility to adapt to any given DNN model, facing an challenge. To address this issue we introduce ARAS, a cost-effective ReRAM-based accelerator that employs a smart scheduler to adapt different DNNs to the resource-limited hardware. ARAS also overlaps the computation of a layer with the weight writing of several layers to mitigate the high writing latency of ReRAM. Furthermore, ARAS introduces three optimizations aimed at reducing the energy overheads of writing in ReRAM. Our key optimization capitalizes on the observation that DNN weights can be re-encoded to augment their similarity between layers, increasing the amount of bitwise values that are equal or similar when overwriting ReRAM cells and, hence, reducing the amount of energy required to update the cells. Overall, ARAS greatly reduces the ReRAM writing activity. We evaluate ARAS on a popular set of DNNs. ARAS provides up to 2.2x speedup and 45% energy savings over a baseline PUM accelerator without any optimization. Compared to a TPU-like accelerator, ARAS provides up to 1.5x speedup and 61% energy savings.

What problem does this paper attempt to address?

The problems that this paper attempts to solve are the adaptability and efficiency issues faced by existing ReRAM - based accelerators when processing deep neural network (DNN) inferences. Specifically: 1. **Adaptability problem**: As the size of DNN models continues to grow, existing ReRAM accelerators, due to their limited hardware resources, are unable to adapt to larger - scale DNN models in the future. Current designs usually assume that the ReRAM cross - bar array has sufficient capacity to store the weights of the entire DNN, but this method becomes impractical in the face of growing model sizes, resulting in excessive hardware requirements and low efficiency. 2. **Write latency and energy consumption problems**: The high write latency and high write energy consumption of ReRAM are major obstacles in designing efficient DNN accelerators. Existing solutions usually reduce write overhead by writing all weights at once and reusing these weights in multiple inferences, but this limits the flexibility and adaptability of the accelerator. To solve these problems, the paper proposes ARAS (Adaptive ReRAM - based Accelerator for DNNs), a cost - effective ReRAM accelerator that improves adaptability and efficiency through the following innovations: - **Intelligent scheduler**: ARAS introduces an offline scheduler that can dynamically manage resources, enabling different DNN models to run efficiently on resource - constrained hardware. The scheduler can overlap the calculation of layers with the weight writing of subsequent layers, thereby alleviating the high write latency of ReRAM. - **Optimization techniques**: ARAS introduces a variety of optimization techniques to reduce the energy overhead of ReRAM write operations. For example, by re - encoding DNN weights, the similarity between inter - layer weights is increased, thereby reducing the energy required to update ReRAM cells. - **Multi - bank global buffer**: ARAS uses a heterogeneous multi - bank scheme and selects the smallest bank according to the storage capacity required for the activation of each layer, thereby reducing static energy consumption. - **Adaptive weight replication scheme**: ARAS improves throughput by simultaneously calculating multiple convolution steps and determines the optimal replication factor to balance the additional weight write overhead and the acceleration effect of each layer. - **Partial weight reuse**: ARAS utilizes partial weight reuse technology to skip the same or similar bits when updating ReRAM cells, further reducing write activities. Through these innovations, ARAS has achieved significant improvements in both performance and energy efficiency. Compared with the baseline PUM accelerator, ARAS provides a speed - up of up to 2.2 times and an energy - efficiency saving of 45%; compared with TPU - like accelerators, ARAS provides a speed - up of 1.5 times and an energy - efficiency saving of 61%.

ARAS: An Adaptive Low-Cost ReRAM-Based Accelerator for DNNs

ERA-BS: Boosting the Efficiency of ReRAM-based PIM Accelerator with Fine-Grained Bit-Level Sparsity

Re2PIM

AERIS: Area/Energy-Efficient lT2R ReRAM Based Processing-in-Memory Neural Network System-on-a-Chip

A Practical Highly Paralleled ReRAM-Based DNN Accelerator by Reusing Weight Pattern Repetitions

AUTOHET: an Automated Heterogeneous ReRAM-Based Accelerator for DNN Inference

A Low-Latency DNN Accelerator Enabled by DFT-Based Convolution Execution Within Crossbar Arrays

ReRAM-Sharing: Fine-Grained Weight Sharing for ReRAM-Based Deep Neural Network Accelerator.

ReDy: A Novel ReRAM-centric Dynamic Quantization Approach for Energy-efficient CNN Inference

A Reduced Architecture for ReRAM-Based Neural Network Accelerator and Its Software Stack

SoBS-X: Squeeze-Out Bit Sparsity for ReRAM-Crossbar-Based Neural Network Accelerator.

AERIS - area/energy-efficient 1T2R ReRAM based processing-in-memory neural network system-on-a-chip.

An Efficient Reram-Based Inference Accelerator For Convolutional Neural Networks Via Activation Reuse

PattPIM: A Practical ReRAM-Based DNN Accelerator by Reusing Weight Pattern Repetitions

Multiscale Co-Design Analysis of Energy, Latency, Area, and Accuracy of a ReRAM Analog Neural Training Accelerator

RRAM-DNN: an RRAM and Model-Compression Empowered All-Weights-On-Chip DNN Accelerator

3A-Reram: Adaptive Activation Accumulation in ReRAM-Based CNN Accelerator

An Energy-Efficient Mixed-Bit CNN Accelerator With Column Parallel Readout for ReRAM-Based In-Memory Computing

APQ: Automated DNN Pruning and Quantization for ReRAM-Based Accelerators

Runtime Row/Column Activation Pruning for ReRAM-based Processing-in-Memory DNN Accelerators

Bit-Transformer: Transforming Bit-level Sparsity into Higher Preformance in ReRAM-based Accelerator