Abstract:Resistive random access memory (RRAM)-based neuromorphic hardware accelerators are attractive platforms for neural network acceleration due to their high energy efficiency. However, the inherent variations of RRAM, arising from diffusion or recombination of oxygen vacancies, can cause significant conductance deviation from the target value, resulting in noticeable performance degradation. In practical ex situ training, write-verify methods are widely adopted to avoid this issue when transferring a trained network model. However, the intense reading and reprogramming operations make the conventional write-verify methods require extensive programming time and energy. In this brief, for the first time, we propose a novel write-verify scheme that can transfer each weight with a different acceptable error margin to achieve a high-speed and high-efficiency write-verify scheme while maintaining network performance. Our experimental results show that the speed and energy efficiency of the write-verify process can be improved significantly, by up to <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\mathbf {\times } 3.4\mathbf {\mathrm {\sim }} \mathbf {\times }9.0$ </tex-math></inline-formula> and <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\mathbf {\times } 4.1\mathbf {\mathrm {\sim }} \mathbf {\times }14.1$ </tex-math></inline-formula> , respectively.

A Study of the Effect of RRAM Reliability Soft Errors on the Performance of RRAM-Based Neuromorphic Systems

Analysis of RRAM Reliability Soft-Errors on the Performance of RRAM-Based Neuromorphic Systems.

Mitigating the Effect of Reliability Soft-errors of RRAM Devices on the Performance of RRAM-based Neuromorphic Systems

Robustness of Neuromorphic Computing with RRAM-based Crossbars and Optical Neural Networks.

Reliable Memristor-based Neuromorphic Design Using Variation- and Defect-Aware Training

Circuit Modeling for RRAM-Based Neuromorphic Chip Crossbar Array with and Without Write-Verify Scheme.

Early-Stage Fluctuation in Low-Power Analog Resistive Memory: Impacts on Neural Network and Mitigation Approach

Intra-array Non-Idealities Modeling and Algorithm Optimization for RRAM-based Computing-in-Memory Applications

Compensation Architecture to Alleviate Noise Effects in RRAM-based Computing-in-memory Chips with Residual Resource

Rescuing RRAM-Based Computing from Static and Dynamic Faults

The Impact of Endurance Degradation in Analog RRAM for In-Situ Training

A Compact Model of Analog RRAM With Device and Array Nonideal Effects for Neuromorphic Systems

Improvement of State Stability in Multi-Level Resistive Random-Access Memory (RRAM) Array for Neuromorphic Computing

Accelerator-friendly neural-network training: Learning variations and defects in RRAM crossbar.

A High-Speed and High-Efficiency Diverse Error Margin Write-Verify Scheme for an RRAM-Based Neuromorphic Hardware Accelerator

Reliability Perspective on Neuromorphic Computing Based on Analog RRAM

Characterizing Endurance Degradation of Incremental Switching in Analog RRAM for Neuromorphic Systems

Weighted Synapses Without Carry Operations for RRAM-Based Neuromorphic Systems

A neuromorphic visual system using RRAM synaptic devices with Sub-pJ energy and tolerance to variability: Experimental characterization and large-scale modeling

Fault-Tolerant Training Enabled by On-Line Fault Detection for RRAM-Based Neural Computing Systems

A Parallel Multibit Programing Scheme with High Precision for RRAM-Based Neuromorphic Systems