Abstract:Resistive random access memory (RRAM) is a promising technology for energy-efficient in-memory computing. However, due to technology limits, RRAM device faces a series of reliability issues. Deep neural network (DNN) computing based on RRAM suffers from accuracy degradation. On the one hand, offline DNN training solutions are difficult to fully consider and simulate all nonidealities. Worse still, new error or nonideality may come up with the usage of RRAM, which further deteriorates the effectiveness of offline training. On the other hand, online training poses great challenges on programming overhead and device lifetime. The iterative writeverify technique to program multi-bit RRAM cells prolongs write latency more than 10x longer than read latency. To overcome these issues, we propose a compensation architecture and a software and hardware co-training design to mitigate the realistic network accuracy loss in RRAM-based computing-inmemory chips. Firstly, we add trainable compensation channels in crossbars utilizing the residual resource after original weight mapping. Secondly, an offline training procedure with computing output from hardware is triggered to settle down appropriate weight value in compensation channels. Experimental results demonstrate that the proposed design can guarantee <= 0.8% loss of accuracy in DNN on MNIST and CIFAR10 dataset even when nonidealities reduce the original accuracy down to =73%.

Online Fault Detection in ReRAM-Based Computing Systems for Inferencing

Fault-Tolerant Training with On-Line Fault Detection for RRAM-Based Neural Computing Systems

Algorithmic Fault Detection for RRAM-based Matrix Operations

Fault-Tolerant Training Enabled by On-Line Fault Detection for RRAM-Based Neural Computing Systems

On-line Fault Protection for ReRAM-based Neural Networks

Online Soft Error Tolerance in ReRAM Crossbars for Deep Learning Accelerators

Fault Tolerance for RRAM-Based Matrix Operations

Mitigating RC-Delay Induced Accuracy Loss in Analog In-Memory Computing: A Non-Compromising Approach

Fault Tolerance in Neuromorphic Computing Systems

Computation-oriented Fault-Tolerance Schemes for RRAM Computing Systems

Bit-Aware Fault-Tolerant Hybrid Retraining and Remapping Schemes for RRAM-Based Computing-in-Memory Systems

Rescuing RRAM-Based Computing from Static and Dynamic Faults

Hardware Fault Tolerance for Binary RRAM Crossbars

Digital Twin Enabled Fault Detection Method for RRAM-Based Neural Computing Systems

A Study of the Effect of RRAM Reliability Soft Errors on the Performance of RRAM-Based Neuromorphic Systems

Compensation Architecture to Alleviate Noise Effects in RRAM-based Computing-in-memory Chips with Residual Resource

Stuck-at Faults in ReRAM Neuromorphic Circuit Array and their Correction through Machine Learning

Intra-array Non-Idealities Modeling and Algorithm Optimization for RRAM-based Computing-in-Memory Applications

Circuit Modeling for RRAM-Based Neuromorphic Chip Crossbar Array with and Without Write-Verify Scheme.

Improving DNN Fault Tolerance Using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI

Zero-Space Cost Fault Tolerance for Transformer-based Language Models on ReRAM