Abstract:Compared with the algorithm optimizations, brain-inspired neural network chips aim to fundamentally change the computer architecture and therefore enhance the computation capability and performance in advanced data processing. In recent years, memristor technology has been investigated in developing high-speed and large-capacity neural network chips. However, it has been observed that memristance values that represent the well-trained network weights can be disturbed by electrical or thermal perturbations. It severely degrades overall system reliability and emerges as a major design challenge. In this work, we systematically analyze the impacts of low-voltage induced memristance drift upon weight disturbance after times of recall operations. A closed-loop design by introducing a real-time feedback controller is proposed to enhance the weight stability of memristor based neural network chips. By mimicking the training process, the controller adaptively compensates the memristance deviation, according to the relation of the input data and recall output. In view of tiny disturbance per access, we integrate the memristance compensation into regular recall operation to avoid the execution speed degradation. Our simulations based on the implementation of representative single-layer (two-layer) network show that the proposed closed-loop design can prolong the service time of memristor-based neural network chip by 14.85x (14.94x), without reducing computational speed. Extra circuitry of the feedback controller induces a negligible overhead about 1.16% on overall power consumption.

Novel Weight Mapping Method for Reliable NVM based Neural Network

Reliable Memristor-based Neuromorphic Design Using Variation- and Defect-Aware Training

The Impact of Non-linear NVM Devices on In-Memory Computing

WESCO: Weight-encoded Reliability and Security Co-design for In-memory Computing Systems

Nonlinear Weight Quantification for Mitigating Read Disturb Effect on Multilevel RRAM-Based Neural Network

Enhancing Security of Memristor Computing System Through Secure Weight Mapping

WAGONN: Weight Bit Agglomeration in Crossbar Arrays for Reduced Impact of Interconnect Resistance on DNN Inference Accuracy

Bit-Aware Fault-Tolerant Hybrid Retraining and Remapping Schemes for RRAM-Based Computing-in-Memory Systems

EFFICIENT WEIGHT MAPPING SCHEME WITHOUT VERIFICATION FOR RRAM BASED NEUROMORPHIC COMPUTING

U-SWIM: Universal Selective Write-Verify for Computing-in-Memory Neural Accelerators

Circuit Modeling for RRAM-Based Neuromorphic Chip Crossbar Array with and Without Write-Verify Scheme.

A Closed-Loop Design to Enhance Weight Stability of Memristor Based Neural Network Chips

A Voltage-Mode Sensing Scheme with Differential-Row Weight Mapping for Energy-Efficient RRAM-Based In-Memory Computing

Memristor-based neural networks with weight simultaneous perturbation training

SWIM: Selective Write-Verify for Computing-in-Memory Neural Accelerators

A Design Methodology for Fault-Tolerant Neuromorphic Computing Using Bayesian Neural Network

A Circuit-Algorithm Codesign Method to Reduce the Accuracy Drop of RRAM Based Computing-in-memory Chip

HXNOR-PBNN: A Scalable and Parallel Spintronics Synaptic Architecture for Probabilistic Binary Neural Networks

QuantBayes: Weight Optimization for Memristive Neural Networks via Quantization-Aware Bayesian Inference

Fast and Accurate Weight Updating Strategy for Resistive Random-Access Memory (Rram)-Based Neural Networks