Abstract:Deep neural networks (DNNs) have gained a strong momentum among various applications. The enormous matrix-multiplication exhibited in the above DNNs is computation and memory intensive. Resistive random-access memory crossbar (RRAM-crossbar) consisting of memristor cells can naturally carry out the matrix-vector multiplication. RRAM-crossbar-based accelerator, therefore, has two orders of magnitude of higher energy-efficiency than conventional accelerators. The imperfect fabrication process of RRAM-crossbars, however, causes various defects and process variations. These fabrication imperfections not only result in significant yield loss but also degrade the accuracy of DNNs executed on the RRAM-crossbars. In this article, we first propose an accelerator-friendly neural-network training method, by leveraging the inherent self-healing capability of the neural network, to prevent the large-weight synapses from being mapped to the imperfect memristors. Next, we propose a dynamic adjustment mechanism to extend the above method for DNNs, such as multilayer perceptrons (MLPs), wherein the imperfect-memristor induced errors can accumulate and magnify through multiple layers. Such off-device training method is a pure software solution, and it is unable to provide enough accuracy for convolutional neural networks (CNNs). Several works propose error-tolerable hardware design by allowing the retraining of CNNs on the RRAM-crossbar. Although this hardware-based on-device training method is effective, the frequent write operation on RRAM-crossbar hurt the endurance of RRAM-crossbars. Consequently, we propose a software and hardware co-design methodology to effectively preserve the classification accuracy of CNN with few on-device training iterations. The experimental results show that the proposed method can guarantee ≤1.1% loss of accuracy for resistance variations in MLP and CNN. Moreover, the proposed method can guarantee ≤1% loss of accuracy even when stuck-at-faults (SAFs) rate = 20%.

ExtendLife: Weights Mapping Framework to Improve RRAM Lifetime for Accelerating CNN.

High Area/Energy Efficiency RRAM CNN Accelerator with Pattern-Pruning-Based Weight Mapping Scheme

A Configurable Multi-Precision CNN Computing Framework Based on Single Bit RRAM

Training Low Bitwidth Convolutional Neural Network on RRAM

Efficient and Robust RRAM-Based Convolutional Weight Mapping With Shifted and Duplicated Kernel

An On-chip Layer-wise Training Method for RRAM Based Computing-in-memory Chips.

Low Bit-Width Convolutional Neural Network on RRAM

Adaptive Weight Mapping Strategy to Address the Parasitic Effects for ReRAM-based Neural Networks

RRAM Based Buffer Design for Energy Efficient CNN Accelerator.

Reducing SRAM Reading Power with Column Data Segment and Weights Correlation Enhancement for CNN Processing.

Static Scheduling of Weight Programming for DNN Acceleration with Resource Constrained PIM

RRAM Based Convolutional Neural Networks for High Accuracy Pattern Recognition and Online Learning Tasks

ReHy: A ReRAM-based Digital/Analog Hybrid PIM Architecture for Accelerating CNN Training

ITT-RNA: Imperfection Tolerable Training for RRAM-Crossbar-Based Deep Neural-Network Accelerator

Area Efficient Pattern Representation of Binary Neural Networks on RRAM

Bit-Aware Fault-Tolerant Hybrid Retraining and Remapping Schemes for RRAM-Based Computing-in-Memory Systems

XB-SIM∗: A Simulation Framework for Modeling and Exploration of ReRAM-based CNN Acceleration Design

NAND-SPIN-based processing-in-MRAM architecture for convolutional neural network acceleration

Improving DNN Fault Tolerance Using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI

RANA: Towards Efficient Neural Acceleration with Refresh-Optimized Embedded DRAM

Mixed Size Crossbar Based RRAM CNN Accelerator with Overlapped Mapping Method