Abstract:The growing size of convolutional neural networks (CNNs) requires large amounts of on-chip storage. In many CNN accelerators, their limited on-chip memory capacity causes massive off-chip memory access and leads to very high system energy consumption. Embedded DRAM (eDRAM), with higher density than SRAM, can be used to improve on-chip buffer capacity and reduce off-chip access. However, eDRAM requires periodic refresh to maintain data retention, which costs much energy consumption. Refresh is unnecessary if the data's lifetime in eDRAM is shorter than the eDRAM's retention time. Based on this principle, we propose a Retention-Aware Neural Acceleration (RANA) framework for CNN accelerators to save total system energy consumption with refresh-optimized eDRAM. The RANA framework includes three levels of techniques: a retention-aware training method, a hybrid computation pattern and a refresh-optimized eDRAM controller. At the training level, CNN's error resilience is exploited in training to improve eDRAM's tolerable retention time. At the scheduling level, RANA assigns each CNN layer with a computation pattern that consumes the lowest energy. At the architecture level, a refresh-optimized eDRAM controller is proposed to alleviate unnecessary refresh operations. We implement an evaluation platform to verify RANA. Owing to the RANA framework, 99.7% eDRAM refresh operations can be removed with negligible performance and accuracy loss. Compared with the conventional SRAM-based CNN accelerator, an eDRAM-based CNN accelerator strengthened by RANA can save 41.7% off-chip memory access and 66.2% system energy consumption, with the same area cost.

An Energy-Efficient Gain-Cell Embedded DRAM Design with Weight Encoding for CNN Applications.

EWS: an Energy-Efficient CNN Accelerator with Enhanced Weight Stationary Dataflow

RRAM Based Buffer Design for Energy Efficient CNN Accelerator.

Reducing SRAM Reading Power with Column Data Segment and Weights Correlation Enhancement for CNN Processing.

Energy-Efficient SRAM Design with Data-Aware Dual-Modes L0T Storage Cell for CNN Processors

Efficient SRAM computing in memory for CNN

RANA: Towards Efficient Neural Acceleration with Refresh-Optimized Embedded DRAM

High Area/Energy Efficiency RRAM CNN Accelerator with Pattern-Pruning-Based Weight Mapping Scheme

HD-CIM: Hybrid-Device Computing-In-Memory Structure Based on MRAM and SRAM to Reduce Weight Loading Energy of Neural Networks

Energy-Efficient Architecture for FPGA-based Deep Convolutional Neural Networks with Binary Weights

A 1T2R1C ReRAM CIM Accelerator with Energy-Efficient Voltage Division and Capacitive Coupling for CNN Acceleration in AI Edge Applications.

An area and energy efficient design of domain-wall memory-based deep convolutional neural networks using stochastic computing

RRAM-DNN: an RRAM and Model-Compression Empowered All-Weights-On-Chip DNN Accelerator

Low power Convolutional Neural Networks on a chip

An Energy-Efficient Mixed-Bit ReRAM-based Computing-in-Memory CNN Accelerator with Fully Parallel Readout.

A High-Throughput and Energy-Efficient RRAM-based Convolutional Neural Network Using Data Encoding and Dynamic Quantization.

Switched by input: power efficient structure for RRAM-based convolutional neural network.

An Energy-Efficient Mixed-Bit CNN Accelerator With Column Parallel Readout for ReRAM-Based In-Memory Computing

Memory optimization of CNN Heterogeneous Multi-Core Architecture

A Novel Low-Communication Energy-Efficient Reconfigurable CNN Acceleration Architecture

Training Low Bitwidth Convolutional Neural Network on RRAM